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BOX PATENT APPLICATION 

ASSISTANT COMMISSIONER FOR PATENTS 

WASHINGTON, D.C. 20231 



APPLICATION FILING UNDER 37 CFR § 1.53(b) 



SIR: 



This is a request for filing a Continuation application under 37 CFR § 1.53(b), of 
pending Prior Application Serial No. 07/7W71 filed on November 12, 1991 by David 
Alumot, Gad Neumann, Rivka Sherman and Ehud Tirosh for Two-Phase Optical 
Inspection Method and Apparatus for Defect Detection. 

1 . A specification that contains no new matter, and a copy of the executed oath or 
declaration from Prior Application Serial No. 07/790,871, filed on November 12, 
1991, is filed herein. 
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^ _ PATENT 

Amendments: 

0 Cancel in this application original claims 2 - 95 of the Prior 

Application before calculating the filing fee. (At least one original 
independent claim must be retained for filing purposes.) 

0 A Preliminary Amendment is enclosed. (Claims added by this 

amendment have been properly numbered consecutively beginning 
with the number next following the highest numbered original 
claim in the Prior Application.) 



3. Method of payment of fees: 

0 Fee Transmittal is enclosed. 

4. Relate Back: 35USC§120: 

0 Amend the specification by inserting immediately after the title and 
before the first line the paragraph: 

" Related Applications 

This is a 

0 continuation 

□ divisional 

of co-pending application(s) 

0 Serial No. 07/790,871 filed on November 12, 1991, which is 
incorporated by reference herein in its entirety/' 

□ International Serial No.: filed on 

and which designated the U.S. 

This application is incorporated by reference herein in its 
entirety/' 
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Inventorship Statement: 

0 With respect to the prior co-pending U.S. application from 
which this application claims benefit under 35 USC § 120, the 
inventor(s) in this application is (are): 

0 the same 

□ less than those named in the Prior Application and it 
is requested that the following inventor(s) identified 
above for the Prior Application be deleted: 



(Type name(s) of inventor(s) to be deleted) 



Assignment: 

0 The Prior Application is assigned of record to Orbot Instruments, 
Ltd. recorded in the Patent Office at Reel No.:5976 Frame No.: 0883. 

□ an assignment of the invention to 

is attached. An additional PTO-1595 Form is also attached. 

Power of Attorney: 

0 The power of attorney appears in the Prior Application. 

0 An Associate Power of Attorney, which includes the undersigned, 
was filed in the Prior Application on 
May 19,1997. 

0 Address all future communications to: 

Christopher M. Tobin, Esq. 
Fenwick & West llp 
Two Palo Alto Square 
Palo Alto, CA 94306 
Tel.: (650)858-7135 
Fax.f(650) 494-1417 
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PATENT 



I hereby declare further that all statements made herein of my own knowledge 
are true and that all statements made on information and belief are believed to be true; 
and further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code, and that such willful false statements 
may jeopardize the validity of the application or any patent issuing thereon. 



Dated 



Respectfully Submitted, 

David Alumot, Gad Neumann, Rivka She; 




By:_ 

Christophfer'IVL Tobin, 
JFENWiaK&V^ESIX 
T^iPalxi_Alto-Sqitare 

TeL^O) 858-7135 
Fax.: (650) 494-1417 




EhudTirosh 



gistration No. 40,290 
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PRELIMINARY AMENDMENT 



Kindly enter the following amendments in the above-referenced case. 
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In the Specification : 

On page 2, replace lines 18-28 with the following paragraph: 

—According to one aspect of the present invention, there is 
provided a method of inspecting the surface of an article for defects by: 
optically examining, in a first phase examination, the complete surface 
of the article and electrically outputting information indicating 
locations on the article suspected of having defects; storing the 
suspected locations in a storage device; and, in a second phase 
examination, optically examining with high resolution only the 
suspected locations of the article's surface for determining the presence 
or absence of a defect in the suspected locations; characterized in that 
the first phase examination is effected by optically scanning the 
complete surface of the article at a high speed with an optical beam of 
small diameter. Thus, by selecting the diameter of the optical beam 
used in the first phase examination, the first phase examination may be 
made at any desired resolution, as compared to the second phase 
examination, according to the particular application.—. 

On page 2, line 31, after "inspected", insert —with a laser beam of small 
diameter--. 

On page 2, line 33, before "converter", change "a" to —an image--. 

On page 2, line 38, change "examining" to —examination—. 

On page 3, line 5, change "examining" to —examination—. 

On page 3, line 19, after "low spatial resolution" insert —such as with a laser 
beam of small diameter—. 
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On page 3, line 26, after "increased" insert -by using a very small diameter 
laser beam--. 

On page 3, line 33, after "N", insert —different-. 

On page 3, line 34, change "images" to —views--. 

On page 3, line 35, after "N", insert —different-. 

On page 3, line 36, change "images" to -views-. 

On page 3, line 36, delete -pattern unit-. 

On page 3, line 38, change "pattern unit" to —surface of the article™. 

In the Claims : 

Please cancel claim 1 without prejudice. 
Please add new claims 96-121 as follows: 



1 96( An inspection device for inspecting a patterned substrate, comprising: 

2 a light source providing a light beam; 

3 an optical system for directing the beam to impinge upon a defined spot on 

4 the substrate; 

5 a plurality of detectors spaced apart from each other but concurrently 

6 directed at the defined spot, said plurality of detectors providing a first 

7 and a second reflection data streams corresponding to reflected light 

8 from the spot to first and second directions; 

9 a memory having a first and a second reference data streams; 



10 a comparator comparing said first reflection data stream to said first reference 

11 data stream and providing a first comparison signal, and comparing 

12 said second reflection data stream to said second reference data stream 

13 and providing a second comparison signal 

1 97. The inspection device of claim 96, further comprising a decision 

2 processor receiving said first and second comparison signals and providing a global 

3 defect alarm. 

1 98. The inspection device of claim 96, further comprising: 

2 a pixel characterizer receiving said first and second reflection data streams 

3 and assigning a corresponding pixel type to each inspected pixel of 

4 said first and second reflection data streams, each pixel type having a 

5 threshold associated therewith; 

6 a subtracter receiving the first and second reflection data streams and the first 

7 and second reference data streams and calculating a difference value 

8 for each inspected pixel of said first and second reflection data streams; 

9 and 

10 wherein for each inspected pixel in said first and second reflection data 

11 stream said comparator compares the difference value to the threshold 

12 associate with the pixel type assigned to said pixel, and issues a defect 

13 alarm when the difference value exceeds the threshold. 
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1 99. The inspection device of claim 98, wherein said difference value 

2 comprises a difference between energy level of said inspected pixel and an average 

3 energy level of a plurality of pixels selected from one of said first and second 

4 reference data streams. 

1 100. The inspection device of claim 98, wherein said difference value 

2 comprises a difference between a first average energy level of said inspected pixel 

3 and selected pixels in close proximity to said inspected pixel, and a second average 

4 energy level of a plurality of pixels selected from one of said first and second 

5 reference data streams. 



1 101 . A semiconductor wafer inspection system having an adaptive 

2 threshold setting capabilities, comprising: 

3 a detector providing a signal of a plurality of inspected pixels; 

4 a pixel characterizer receiving said signal and associating with each inspected 

5 pixel an inspected pixel type depending on the intensity of the 

6 inspected pixel; 

7 a comparator receiving the signal of each of said inspected pixels and the 

8 associated inspected pixel type and determining therefrom a 

9 corresponding threshold, said comparator further performing a 

10 threshold-based comparison operation between each of the inspected 

it pixels and a reference data. 
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1 102. The inspection system of claim 101, wherein said comparator further 

2 comprises: 

3 an average circuit providing an average intensity of said reference data; 

4 a subtracter providing an intensity difference between the intensity of the 

5 inspected pixel and the average intensity of the reference data; and 

6 wherein said threshold-based comparison operation comprises comparing the 

7 intensity difference to the corresponding threshold. 

1 103. A method of inspecting a patterned semiconductor wafer, comprising 

2 the steps of: 

3 illuminating a defined spot on the wafer with a light beam; 

4 obtaining a first pixel data from a light reflected from the spot to a first 

5 direction; 

6 obtaining a second pixel data from a light reflected from the spot to a second 

7 direction different from the first direction; 

8 obtaining a first reference pixel data from a memory and comparing said first 

9 pixel data to said first reference pixel data to determine whether said 
w first pixel data points to a presence of a defect on the spot; 

11 obtaining a second reference pixel data from the memory and comparing said 

n second pixel data to said second reference pixel data to determine 

13 whether said second pixel data points to a presence of a defect on the 

u spot. 
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1 104. A method of inspecting a patterned semiconductor wafer, comprising 

2 the steps of: 

3 illuminating a defined spot on the wafer with a light beam; 

4 obtaining an inspected pixel of the spot; 

5 inspecting the characteristics of the inspected pixel and assigning a pixel type 

6 to the inspected pixel, corresponding to the characteristics of the 

7 inspected pixel data; 

8 obtaining a reference data from a memory and comparing the inspected pixel 

9 to said reference data in correlation to the assigned pixel type to 

10 determine whether the inspected pixel points to a presence of a defect 

11 on the spot 

1 105. The method of claim 104, further comprising the steps of; 

2 providing a threshold level corresponding to the assigned pixel type; 

3 obtaining a difference value between the inspected pixel and the reference 

4 data; and 

5 comparing the difference value to said threshold level to determine whether 

6 the inspected pixel points to a presence of a defect on the spot. 

2 106. The method of claim 105, wherein said reference data comprises an 

2 average energy of a reference pixel corresponding to the inspected pixel, and energy 

3 of reference neighboring pixels situated in close proximity to said reference pixel. 
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1 107. A method of inspecting a patterned semiconductor wafer, comprising 

2 the steps of: 

3 illuminating a defined spot on the wafer with a light beam; 

4 obtaining an inspected pixel and inspected neighborhood pixels neighboring 

5 said inspected pixel; 

6 inspecting the characteristics of the inspected pixel and assigning a pixel type 

7 to the inspected pixel; 

8 obtaining a reference data and a reference data type from a memory and 

9 comparing the inspected pixel to said reference data in correlation to 
w the assigned pixel type and reference data type to determine whether 
n the inspected pixel points to a presence of a defect on the spot. 

1 108, The method of claim 107, further comprising the steps of: 

2 comparing the energy level of the inspected pixel to the energy level of the 

3 inspected neighborhood pixels to determine whether a large variation 

4 in energy exists; 

5 when a large variation in energy exists, obtaining a convoluted energy of the 

6 inspected pixel and the neighborhood inspected pixels, and comparing 

7 the convoluted energy to the reference data in correlation to the 

8 assigned pixel type and reference data type to determine whether the 

9 inspected pixel points to a presence of a defect on the spot. 

1 109. A method for inspecting a substrate to determine whether the 

2 substrate includes a defect, comprising: 

8 



3 providing first and second inspection data streams that correspond to 

4 different perspectives of a single specified location on the substrate; 

5 providing first and second reference data steams that respectively correspond 

6 to the first and second inspection data streams; and 

7 comparing the first inspection data stream to the first reference data stream 

8 and the second inspection data stream to the second reference data 

9 stream. 

1 110. The method of claim 109, wherein said comparing step comprises: 

2 assigning a pixel type to each pixel in the first and second inspection data 

3 streams; 

4 comparing each inspected pixel to a corresponding reference pixel, selected 

5 from one of said first and second reference data streams, using 

e threshold values that vary depending upon the assigned pixel type. 

1 111. A semiconductor wafer inspection system having an adaptive 

2 threshold setting capabilities, comprising: 

3 a detector providing a signal of a plurality of inspected pixels; 

4 a pixel characterizer receiving said signal and associating with each inspected 

5 pixel an inspected pixel type depending on the intensity of the 

6 inspected pixel and the intensity of pixels neighboring said inspected 

7 pixel; 

8 a comparator receiving the signal of each of said inspected pixels and the 

9 associated inspected pixel type and determining therefrom a 
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corresponding threshold, said comparator further performing a 
threshold-based comparison operation between each of the inspected 
pixels and a reference data. 

112. An apparatus for inspecting an article to determine whether the article 
includes a defect, the apparatus comprising: 

an array of detectors, which provide first and second inspection information 
streams that comprise streams of pixel data which respectively 
correspond to different perspectives of a specified location on the 
article; 

a processor, in communication with the detectors, which compares the first 
inspection information stream to a first reference information stream 
and the second inspection information stream to a second reference 
information stream to detect a defect in the article, and which assigns 
one of a plurality of types to each pixel in the inspection information 
streams using predetermined parameters and compares pixels in each 
inspection stream to pixels in each reference stream using threshold 
values that vary dependent upon the assigned type. 

113. A method for inspecting an article for defects comprising: 
illuminating a series of locations on the article with both dark field and bright 

field illumination; 



t • 

4 providing first and second dark field information streams that respectively 

5 correspond to a different dark field perspective for each location in the 

6 series; 

7 providing first and second reference information streams that correspond to 

8 the first and second dark field information streams; 

9 comparing the first dark field information stream to the first reference 

w information stream to provide a first comparison signal and the second 

11 dark field information stream to the second reference information 

12 stream to provide a second comparison signal; 

13 providing a bright field information stream that corresponds to each location 
u in the series; and 

15 using the first and second comparison signals and the brightf ield information 

16 stream to determine whether the article includes a defect. 

1 114. The method of claim 113, wherein at least one threshold for providing 

2 the first and second comparison signals is dynamically adjusted based upon a pixel 

3 type that is assigned to pixels in the first and second dark field information streams. 

1 115. The method of claim 114, wherein the intensity of each pixel relative to 

2 neighboring pixels is used to assign the pixel type. 

1 116. An apparatus for inspecting an article for defects comprising: 

2 an optical system, which illuminates a series of locations on the article with 

3 both dark field and bright field illumination; 
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4 an array of detectors, which provides first and second dark field information 

5 streams that respectively correspond to a different dark field 

6 perspective for each location in the series; 

7 a memory, which provides first and second reference information streams 

8 that correspond to the first and second dark field information streams; 

9 a comparator, which compares the first dark field information stream to the 
w first reference information stream to provide a first comparison signal 
22 and the second dark field information stream to the second reference 

22 information stream to provide a second comparison signal; 

23 a bright field detector, which provides a bright field information stream that 

24 corresponds to each location in the series; and 

25 a decision processor, which uses the first and second comparison signals and 

26 the brightfield information stream to determine whether the article includes a defect. 

2 117. The apparatus of claim 116, wherein at least one threshold for 

2 providing the first and second comparison signals is dynamically adjusted based 

3 upon a pixel type that is assigned to pixels in the first and second dark field 

4 information streams. 

1 118. The apparatus of claim 117, wherein the intensity of each pixel relative 

2 to neighboring pixels is used to assign the pixel type. 

2 119. A method for determining whether an article includes a defect, the 

2 method comprising: 
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3 illuminating a series of locations on the article; 

4 providing an inspection information stream using light reflected from the 

5 article as a result of the illuminating step; 

6 providing a reference information stream; and 

7 detecting a defect in the article by: 

8 determining whether the difference between data in the inspection 

9 information stream and data in the reference information 
w stream exceeds a threshold level; and 

21 dynamically adjusting the threshold level so that different threshold 

22 levels are provided for different locations in the series of 

23 locations on the article. 

1 120. The method of claim 119, wherein the step of dynamically adjusting 



2 the threshold level incorporates a determination of the intensity of pixels in the 

3 inspection information stream that correspond to the different locations on the 

4 article. 

1 121. The method of claim 120, wherein the intensity of each pixel relative to 

2 neighboring pixels is used to assign the pixel type. 
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REMARKS 



Claims 1-95 have been cancelled without prejudice to pursue their subject matter 
in this or a continuation application. New claims 96-122 are presented to provide the 
Applicants with the scope and breadth of claim coverage to which they believe they are 
entitled. 

Favorable action and early allowance are solicited. 

Respectfully submitted, 
David Alumot, et au, 

Date: 

03 Pec By: 

ChristopheryM. Tobin 

Registration No. 40,290 

Fenwick & West LLP 

Two Palo Alto Square, Suite 600 

Palo Alto, CA 94306 

(415) 858-7135 
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COMMISSIONER OF PATENTS AND TRADEMARKS 




Certifying Officer 



( ) flPTTCAL IKSPtCTION HgTHOP AND APPARATUS 



ring aw gAcrCTcvw? or thi nwRffrat 

The present invention reiste* to * method and apparatus for 
optically impacting the surface of an article for defects. The invention 
is particularly useful for optically inspecting patterned semiconductor 
wafers used in producing Integra ted -circuit *Ues or chips, and the 
invention is therefore described below particularly with respect to this 
application. 

The inspection of unpatterned semiconductor wafers for 
surface- lying particles is relatively simple and can be easily automated. 
In one known type of such system, the wafer is scanned by a laser beam, and 
a photodetector detects the presence of a particle by collecting the light 
scattered by the particle. However, the inspection of patterned 
semiconductor wafers for defects in the pattern is considerably more 
difficult because the light scattered by the pattern overwhelms the light 
scattered from the particles or defects, thereby producing high rates of 
false alarms. 

The existing inspection systems for inspecting patterned wafers 
are generally based on analyzing high resolution two-dimensional images of 
the patterned wafer utilising an opto-electric converter, such as a CCD 
(charge-coupled device), on a pixel-by-pixel basis. However, the extremely 
large number of pixels involved makes such systems extremely slow. For 
this reason, the inspection of patterned wafers is done at the present time 
almost only for statistical sampling purposes. As a result, microdefects 
in patterned semiconductor wafers remain largely undetected until a 
considerable number of such wafers have been fabricated and have begun to 
exhibit problems caused by the defects. The late discovery of such defects 
can therefore result in considerable losses, low yields, and large 
downtimes. 

There is therefore an urgent need to inspect patterned 
semiconductor wafers at relatively high speeds and with a relatively low 
false alarm rate in order to permit inspection during or immediately after 
the fabrication of the wafer so as to quickly identify any process 
producing defects and thereby to enable immediate corrective action to be 
taken. This need is made even more critical by the increasing element 
density, die size, and number of layers in the integrated circuits now 
being produced from these waters, and now being designed for future 



production, which requires that the number of microdefects per wsfer be 
drastically reduced to attain * reasonable die yield. 



wscrs m mzr sotwy or rat iftrorriw 

An object of the proaant invention is to provide * novel method 
and apparatus having advantages in the abova respects for inspecting the 
surface of articles for defects. 

In particular, an objact of tha invention ia to provida a method 
and apparatus for automatically inspecting patterned semiconductor wafers 
ch-- racterixed by a ralativaly high speed and relatively low rata of false 
alarms such that tha pattamad wafara say ba testad whila tha wafars ara in 
the production line to quickly anable the fabrication peraonnel to identify 
any procass or equipment causing yiald reduction, to racaiva faat faadback 
information aftar corractiva actions, and to predict potential yiald loss. 

A still further objact of the invention is to provide an 
inspection method and apparatus which ara capable of inspecting all the 
critical layers i and which supply data on defects caused by the presence of 
particles and defects in the patterns. 

According to the present invention, there is provided a method of 
inspecting the surface of articles for defects, comprising: placing the 
article to be inspected on a table; in a first phase, optically examining 
the complete surface of tha article on tha table at a relatively high speed 
and with a relatively low spatial reaolution; electrically outputtmg 
information indicating suspected locations on the article having a high 
probability of a defect; storing the output ted information in a storage 
device; and in a second phasa, whila the article ia still on the table, 
optically examining with a relatively high spatial resolution only the 
suspected locations stored in the storage device for the presence or 
absence of a defect in the suspected locations. 

According to further features of tha invention, tha first 
examining phase is effected by optically scanning the complete article 
surface to be inspected; and the second examining phase is automatically 
effected immediately after the first ph»u^ by imaging only the suspectad 
locations on a converter which converts the images to electrical signals 
and then analyses the electrical signals. 

According to still further features in preferred embodiments of 
the invention described below, the surface of the article to be inspected 
includes a pattern, a.g,, a patterned wafer used for producing a plurality 
of mtegrated-circuit dies or chips. The first examining phase is effected 




by making * comparison between the inspected pattern and another pattern, 
serving at a reference pat tarn, to identify locations on tha inspected 
pat tarn wherein thara ara sufficient difftrencts with respect to tha 
rafaranca pattarn to indicate a high probability of a da fact in tha 
inapactad pattarn. Tha sacond examining phaaa is also effected by making a 
comparison between the inspect ad pattarn and tha rafaranca pattarn, to 
identify locations on tha inspected pattarn wharain tha comparison shows 
sufficient diffarancas with respect to tha rafaranca pattarn to indicate 
tha prasanca of a dafact in tha suspected location of tha inspected 
pattern. 

Tha rafaranca pattarn nay be a pattern on another like article 
(e.g., die-to-die comparison), another like pattern on the same article 
{repetitive pattern companion), or data stored in a database (die-to* 
database comparison) . 

It will thus be seen that the novel sethod of the present 
I | invention primarily monitors changes in the defect density while 

maintaining a high throughput with a relatively low false alarm rate. Thus, 
the first examination is done at a relatively high speed and with a 
relatively low xpatial resolution to indicate only suspected locations 
having a high probability of a defect; and the second examination is done 
with a relatively high spatial resolution but only with respect to the 
suspected locations navmg a high probability of a defect. The sensitivity 
of the two phases may be adjusted according to the requirements for any 
particular application. Thus, where the application involves a relatively 
low number of defects, the sensitivity of the first examination phase may 
be increased to detect very small defects at a high apeed but at the 
expense of an increased false alarm rate. However, since only relatively 
few suspected locations are examined in the second phase, the overall 
inspection can be effected relatively quickly to enable the fabrication 
personnel to identify defects caused by any process or equipment, and to 
immediately correct the cause for such defects. 

According to a further feature of the invention, the first 
examining phase is effected by generating a first flow c* N streams of data 
representing the pixels of different images of the inspected pattern unit; 
generating a second flow of H streams of data representing the pixels of 
different images of the reference pattern unit; and comparing the data of 
the first flow with tha data of the second flow to provide an indication of 
the suspected locations of the inspected pattern unit having a high 
probability of a defect. 
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According to still further features of the invention, the pattern 
is based on * grid of angularly-spaced lines <e.g w 45* spacing); and the 
K streams of data in each flow art generated by a circular array of light 
collectors. The light collectors are 1 oca tad to coll act tha light in 
rag ions midway between tha angularly- spaced linas of tha grid. Such an 
arrangement minimises tha amount of pattern- reflected light, collactad by 
tha light collactors; that is, such an arrangement doaa not sea most of tha 
pattern, except pattern irregularities, corners and curves. 

Preferably, there are eight light collectors each located to 
collect the light in a region midway between each pair of the 
angularly- spaced linas of tha grid; it is contemplated, however, that tha 
system could include another member, e.g., four such light collectors 
equally spaced between the grid lines. 

According to still further features of the invention, tho second 
examining phase is effected by imaging on a converter each suspected 
location of the inspected pattern unit and the corresponding location of 
the reference pattern unit to output two sets of electrical signals 
corresponding to the pixels of Ihe Inspected pattern unit and the reference 
pattern unit, respectively; and comparing the pixels of the inspected 
pattern unit with the corresponding pixels of the reference pattern unit to 
indicate a defect whenever a aismatch of a predetermined magnitude is found 
to exist at the respective location. Each suspected location of the 
inspected pattern unit and the reference pattern unit is imaged at a 
plurality of different depths, and the electric signals of one set are 
shifted with respect to those of the other set to match the respective 
depths of the images 4 

The invention also provides apparatus for inspecting articles « 
particularly patterned semiconductor wafers, in accordance with the above 
method. 

Further features and advantages of the invention will be apparent 
from the description below. 

BRIgr DESCRIPTION OT THE DRAWINGS 

The invention is herein described, by way of example only, with 
reference to the accompanying drawings, wherein: 

rig. 1 is a pictorial illustration of one form of apparatus 
constructed in accordance with the present invention; 

fig. 2 is a block diagram of the apparatus of rig. t; 



rig. 3 U i diagram 11 lustra tin? the wafer handling and 
image-acquisition system in the apparatus of rigs. 1 and 2; 

rig. 4 is a diagraa illustrating the optic system in tha first 
examining phase of tha apparatus of rig. 1; 

rig. 5 is a top plan view illustrating tha disposition of tha 
light collectors in tha optic a* stem of Tig. 4; 

Fig. 6 is a diagram aora particularly Illustrating tha 
disposition of tha light collactors in rig. 5, rig. 6a showing a 
variation; 

rigs. 7 and 7a ara diagrams Illustrating ona of tha light 
collactors in tha arrangements of figs. 6 and 6a, respectively; 

figs, 8 and 6a ara diagrams aora particularly illustrating tha 
light collecting zones in tha arrangements of rigs. 6 and 6a , 
respectively. 

figs. 9-11 are diagrams illustrating the manner of scanning the 
wafer in the Phase X examination; 

rig. 12 is a block diagram illustrating the Phase I processing 

system; 

rig. 13 is a block diagram illustrating the mam components of 
the preprocessor in one channel of the processing system of rig. 12; 

rig. 14 is a block diagram illustrating one channel in the 
processing system of rig, 12 following the preprocessor, rig. Ma 
illustrating the algorithm involved in one of the operations performed by 
that system; 

rig, IS is a block diagram particularly illustrating a portion of 
the processing system of fig. 14; 

rig. 16 is a block diagram particularly illustrating the 
Threshold Processor in the processing system of rig. 12; 

rig. 17 is a block diagram mora particularly illustrating the 
Pixel Charecteriter of rig. 15, rig. Ha illustrating the algorithm 
involved; 

rigs. 18, 19 and 20 are block diagrams more particularly 
illustrating the Ratio, Gradient and Maximum Definition Calculator in the 
system of rig. 17; 

rigs, 21a and 21b illustrata the nine registers in the Ratio 
Calculator and Gradient calculator, respectively; 

rig. 22 illustrates the Score Calculator in the image piocessor 
channel of Fig. 14, rig. 22a being diagrams helpful in understanding the 
operation of the crossbar switch (?3i) of rig. 22; 



Pig. 23 is * block diagram helpful in understanding tha oparation 
of the score calculator of rig. 22; 

rig. 24 li ■ block diagram illustrating mora particularly the 
Oaf act Detector portion of tha image processor of rig. 14; 

rig. 23 is t block diagraa illustrating more particulars of the 
comparator 77 of rig. 24, rig. 25a illustrating the algorithm involved; 

rig. 26 is a diagraa illustrating tha aaln elements of tha Phase 
XX optic systaa; 

rigs. 27-31 ara diagrams illustrating tha construction and 
oparation of tha Phase XX examination systaa); 

rig. 32 is a diagras halpful in sxplaining tha repetitive-pattern 
comparison tschnlqus; 

rigs. 33, 34 and 35 ara block diagraas corresponding to Pxga. 12. 
14 and 24. respectively, but showing tha aodif icetiona for tha repetitive 
pattern-pattern comparison tachnlqua; 

rig. 36 is an optical diagras corresponding to rig* 26, but 
illustrating Modifications m tha Fhaas XX examination; 

rig. 37 is a diagras halpful in explaining tha aodif icattens in 
tha Phafre XX exam; nation; 

rigs* 36 and 39 ara block diagraas corrasponding to rigs. 27 and 
28, respectively, but showing tha changes in tha Phase XX examination; 

rig, 40 is a block diagram illustrating an implementation of a 
die-to-databeae comparison technique; 

rigs. 41 and 42 ara diagraaa illustrating tha kinds of corners, 
and kinds of curves, involved in tha system of r. 40; 

rig, 43 is a diagram illustrating tha array of detectors involved 
in the system of rig. 40; 

rigs. 44 t 45 and 4$ further diagrams helpful in explaining tha 
operation of the system of Fig. 40; 

Fig. 47 is a bloc* diagram illustrating the preproceaaor in tha 
systea of rig. 40; 

rig. 46 is a block diagram halpful in explaining tha oparation of 
the spanner in tha ayatea of rig. 40; and 

rig. 49 is a flow chart illustrating tha operation of tha spanner 
in the system of fig. 40. 
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/ BESgBlPTION Of A PttgPTRftH) EMBODIMENT 



frvrell Svltei 

The systea illustrated in the drawing* it designed particularly 
for automatically impacting patterned semiconductor wafers having a 
plurality of lika integrated-circuit die* aach formed with like patterns. 
Tha ayitaa inspects aach pattam, called tha inapactad pattam, by 
comparing it with at laaat one othar pattam on tha wafer, aarving aa tha 
reference pattam, to datact any differences which would indicata a defect 
in tha inapactad pattam. 

Tha impaction ia made in two phaaaa: In tha firat phase, tha 
complete aurfaca of tha wafar ia inapactad at a relatively high apaad and 
with a raiativaly low apatial reaolution? and information ia outputtad 
indicating suspected location* on tha wafar having a high probability of a 
defect, Thaaa location* ara *torad in a atoraga da v lea. In tha second 
pfwse, only tha auapactad locations storad in tha storaga davica ara 
«xa*\ned with a raiativaly high apatial raaolution; and a determination ia 
made aa to tha praianca or absence of a dafact. Thia facilitataa 
identification and correction of tha procaaa that craatad tha dafact. 

The inspection apparatua illustrated in Fig*. 10 of tha drawinga 
includaa a tabla 2 for racaiving tha wafar w to ba inapactad. Tha firat 
phaaa impaction of tha wafar is by a laaar 3 outputting a lasar beam which 
acana tha complete surface of tha wafar «; and a plurality of light 
collectors 4 arranged in a circular array to collect the light scattered 
from tha wafer and to transait tha scattered light to a plurality of 
detectora 5. Tna outputs of the detectors 5 ara fed via a Phase I 



t , preprocessor 6 to a Phaae 1 image processor 7, which processes tha ^ 

[ information under the control of a mam controller 6. The Phaaa I image * - 

j proceasor ? processes the outputs of the detectors 5 and produces 

I information indicating suspected locatione on tha wafer having a high 

probability of a defect. These suspected locations ara stored within a ^ 
storaga device in tha mam controller 6. 

Only the suspected locations having a high probability of a 
defect ara examined by the Phase II examining system. This system includes 
» , an optic systea for imaging the suspected location on an opto-electnc _ ^ 

converter, e.g., a CCD satnx 9, which converts tha images to electric *" ' 

signala. These signals are fed via a Phase It preprocessor 10 to a Phase 
' II image processor 11 which, under the control the main controller 8, 
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output* information indicating the presence or absence of a defect in each 
suspected location examined in Phase XI. 

In the block diagram illustrated in rig. 2, the table 2 of rig. 
1, and aaaociatad elements involved in the wafer handling ay* tee, are 
indicated generally by block 12. Table 2 is controlled by a movement 
control system, indicated by block 13* to effect the proper positioning of 
the wafer on the table 2 in each of the Phase I and Phase IX examination 
phases » and also the scanning of the wafer tf in the Phase X anamination. 

The light detectors 5 of Fig. 1 are included in the Phase I iaage 
acquisition aenaor indicated by block 3 1 in Pig. 2; and the opto-alectric 
converter 9 of rig. 1 is included within the Phase XX image acquisition 
sensor indicated by block 3^ in Pig. 2. 

rig. 2 also illustrates a post processor 14 processing the 
information from the Phase X processor 7; the main controller 8 which 
manages and synchronize* the data and controls the flow; a keyboard 13 
•nab ling the operator to input information into the main controller 6; and 
a monitor 16 enabling the operator to eonitor the procassing of the 
information. 

All the elements in the wafer handling and image acquisition 
subsystem for both phase* are included within the broken-line box generally 
designated A in rig. 2; all the elements of the image processor subsystem 
(both the algorithms and the hardware) for both phases are indicated by the 
broken- 1 in* block B; and all the elements in the operator console subsystem 
are indicated by the broken-line block C. The latter subsystem includes 
not only the main controller 6, keyboard 15, and monitor 16, but also a 
graphic terminal unit, shown at 17 in Pig. 1, 

The other elements illustrated in rig. 1 are described more 
particularly below in connection with their respective subsystems. 

waf?r Handling and lEaqt n«u.inUgn 

rig. 3 more particularly illustrates the wafer handling and image 
acquisition subsystem Sa {rig. 2). 

This subsection includes the table 2 which is of a large mass 
(such as of granite). Zt is mounted on vibration Isolators 20 to daiapen 
high frequency vibrations from the outside world. 

The subsection illustrated in rig. 3 also includes the movement 
controller 13 controlled by the main controller 6. Movement controller 13 
controls a one-directional scanning stage 21 . Thla stage moves a vacuum 
chuck 24 which holds the wafer flattened during its movement in one 



orthogonal direction with respect to the Phase I ••mors 3, as the laser 
^Ia» from the laser 3 it deflected in the other orthogonal direction to 
*can the complete surface of tha wafer during tha Phase I examination. 

Movement controller 13 furthar controls a two-dimentional 
scanning staga 22 effective, during tha Phaaa IX examination, to petition 
tha wafar at any da«irad position with raapact to tha Phase XI datactor 9 
{tha CCD matrix). At described in detail below, the control of one of tha 
axes of this staga serves slso during the Phase I examination. Movement 
controller 13 further controls a rotation/level/focus stage 23, which 
rotates the wafer about its axis to align it angularly, to level it, and to 
keep it in focus during scanning. Stage 23 also roves the vacuum chuck 24 
and its wafer towards or away from the Phase IX sensor 9 to enable 
producing a plurality of images at different depths during the Phase XX 
examination, as will be described more particularly below. 

rig, 3 also schematically illustrates a wafer handier 25 which 
transfers the wafer H between the vacuum chuck 24, a wafar prealigner 2b, 
and cassettes 2? and 28. Tha wafer prealigner 26 initially aligns the 
wafer angularly and canters it, and also schematically illustrated in rig. 
3 is an optical character recognition unit 29 which reads the wafer 
identification code. 

The foregoing components are generally individually well-known 
and are therefoie not described herein in detail* 



As shown in rig. 4, the laser 3 ie an argon laser) outputs a 
laser be*a which is psssed through a polarizer beam splitter 30 oriented in 
such a way to transmit the laser light to the wafer W, but to reflect the 
reflected light from tho wafer to a photodetector 31. The latter outputs 
an electric signal controlling the Phase I preprocessor 6. The laser beam 
from beam splitter 30 is psssed through a beam expander 32, then through a 
cylindrical lens 33a, a deflector 34, another cylindrical lens 33b, a 
folding mirror 35, a muiti-msgnif ication telescope 36, a beam splitter 37, 
a quarter wavelength plate 36 which converts the linearly polarised light 
to a circularly polarized light and vice versa, and finally through a 
microscope objective 39, which focuses the laser beam on the wafer W. 

The beam expander 32 expands the laser beam diameter to fill the 
optic aperture of the deflector 34, and the cylindrical lens 33a focuses 
che laser beam onto the deflector 34. Deflector 34 is an acousto-optic 
deflector. It scans the User bean in one orthogonal direction m a 
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stwtooth pattern in the time domain, while the sot ion controller moves the 
tabls (and the wafer thereon) in the othar orthogonal direction in order to 
acan the complete surface of the wafer. The folding mirror 35 reflects the 
laser beam into the aulti -salification tmlescopm 36, which eat chat the 
laser beam diameter and scan aperture to fit the input requirements of 
standard microscopic optics. Slit 40 within telescope 36 permits only the 
first order detracted light of the laser beam to impinge the wafer If. 

Beam splitter 37 p^§u»M s part of the beam to the wafer, as 
described above, and reflects another part to an auto focus unit 41, which 
determines whether the wafer is in the focus of the microscope objective 
39. The autofocus unit can be a standard one, such as the one used in the 
Leit* Ergo lux microscope. 

The light reflected from the laser beam by the wafer W being 
inspected is collected by a plurality of light collectors 42 arranged in a 
circular array around the objective lens 39, as shown mors particularly in 
Figs. 5 and 6. The pattern on the wafer W is based on a grid of lines 
spaced 45* from each other. The circular array of light collectors 42 are 
located to collect the light in the regions midway between the 
angularly- spaced lines of the grid, in order to minimize the amount of 
pattern-reflected light collected by them. In the example illustrated in 
rigs. 5 and 6, there are eight of such light collectors 42, each spaced 
midway between two adjacent grid lines. The apparatus, however, could 
include only four of such light collectors, as described more particularly 
below with respect to rigs. 6a, 7a and 8a. 

Baffles 43 (Fig. 7) keeps spurious laser light from reaching the 
wafer «. rurther baffles 44 (Fig. 6) between the light collectors 42 limit 
the field of view of the light collectors 42 to the predetermined region on 
the wafer to airuouze the amount of spurious laser light collected by 
them. 

Each of the light collectors 42 includes an optic fibre having an 
inlet end 42a (Fig. 7) adjacent to the point of impingement of the laser 
beam on the wafer W, in order to collect the light scattered by the wafer, 
and an outlet end 42b adjacent a lens 45 for focussing the light onto a 
photodetector sensor 46. 

The inlet end 42a of each optic fibre is confined to a shaped, 
curved region, as more particularly illustrated at 47 in Fig. 6. This end 
of each region has a pair of sides 47a, 47b, converging from a base 47c, 
which base is located substantially parallel to the table 2 receiving the 



wafer N to bi inspected. Tht two tides 47a, 47b converge to a pointed tip 
47d overlying the table receiving the wafer. 

As shown in rig. 6, the inlet ends of the optic fibres 42 thus 
define light collecting cones o, separated by non-collecting zones B. In 
the illustrated example, the width of each light -collecting tone a is 16* 
at the hot ton surface (47c) , and its height (♦) is 49*. Such an 
arrangement minimizes the pat tern* reflected light, and maximizes the 
defect-reflected light, collected by the light collectors* 

Another example of the light -gathering optics which may be used 
is illustrated in rigs. 6a, 7a and 8a, corresponding to the above-described 
rigs. 6, 7 and 6, respectively. In this example, there are only four light 
collectors* therein designated 42 \ located at angles of 45*, 135*, 225* 
and 315*, respectively. This configuration is useful when the object to be 
inspected consists of lines in only two orthogonal directions (0* and 90*). 
Another advantage of this configuration is that the objective 39* may have 
a higher numerical aperture, and thus the spot site used for scanning may 
be smaller. The light collecting zones in this configuration are 
illustrated at 47* in rig. da. As one example, the width o of the light 
collecting zones may be 30*, and their height may be 45*. 

As shown in rig. 9, the wafer W being inspected is formed with a 

plurality of integrated-circuit dies 0<-D each including the same 

1 n 

pattern. In the Phase I examination, the complete surface of the wafer is 
scanned by the laser beam 3, and the resulting scattered light is collected 
by the above-described light collectors 42 in order to detect defects, or 
at least those suspected areas having a high likelihood of including a 
defect and therefore to be more carefully examined during the Phase IX 
examination. As also indicated above, during the Phase I examination (and 
also the Phase II examination) , the pattern of one die D, serving as the 
inspected pattern, is compared with the light pattern of at least one other 
die, serving as the reference pattern, to determine the likelihood of a 
defect being present in the inspected pattern. 

rigs. 9-11 illustrate the manner of carrying out the scanning of 
the wafer in the Phase I examination. 

Thus, as shown in rig, 9, the laser beam is deflected in the 
X-direction by the acousto-optic deflector 34 trig. 4) so as to form a 
scanning line shown at 50 m rig. 11. At the same time, the scanning stage 
21 of the table 2 supporting the wafer w moves the wafer beneath the wafer 
spot at a continuous constant velocity in the Y-dirfcctton, to thereby 
produce a raster scan indicated at 51 in rig. 11. In the example 



illuet rated, the scanning length of line 50 ia 1 s» <t,000 microns); the 
distance between two adjacent Unti S y is 0.6 microns; and the distance 
equal to th« sampling distance (3^) in the X-direction is similarly 0.6 
microns. The spot sita of the lasar beam, shown at 52, is about 3.0 
microns U.a., covering approximately 5 sample points). 

Thus, tha scanning stags 21 scans tha wafar between tha points a 
and b in tha Y-direction, aa shown in rig. 9* As a result, an araa is 
covarad having a width (w) of about 1 aa, and a langth equal to tha 
distance batwaan point a and b. 

Tha wafar is than moved in tha X-diraction from point b to point 
c (rig. 9) by tha scanning stage 22 (rig. 3), and tha araa batwaan points c 
and d is than scanned , and so forth. 

Tha scanning is dona in such a way that there is an overlap (t, 
Fig. 10) between adjacent stripes scanned by the laser beam 52. Zn the 
example illustrated in the drawings, tha overlap (t) ia 0.2 mm. 

Zn this manner, different dies on the same wafer are continuously 
scanned to produce the scattered light collected by the light collectors 42 
(or 42*, figs. 6a-6a) so as to enable a die-by-die comparison to be made of 
each die, called the inspected die, with another die, called the reference 
die, to produce an indication of the probability of a defect m tha 
inspected die. 

Aa indicated earlier, the Phase Z examination system nay include 
eight light detectors 46 (or four light detectors where the variation of 
rigs. 6a -8a ia used) for inspecting the wafer for defects. However, it may 
also include a further detector (a reflected light detector) to provide 
additional information for the registration procedure. Thus, the 
misalignment may be detected from the reflected light detector image by 
computing the croas-correlation between a rectangle of pixels in the 
inspected image, and the rectangle of pixels in the refer once image in ail 
possible misalignments. This information may be used where the score 
matrix computed in the alignment control circuit does not provide a 
significant indication of the correct misalignment. 

?h&91. L.IPM* Processor 

The Phase X examination is effected by: (a) generating a first 
{low of N streams o£ data (N being the number of light collectors 42, or 
42*) repreaentmg the pixels of different images of the inspected pattern; 
(h) generating a second clow of H streams of data representing the pixels 
of different images of the reference pattern; and (c) comparing the data of 



th« first Clow with the date of tha second flow to provide an indication fay 
tha coapariaon of tha suspected locations of the impacted pattern having a 
high probability of a defect. Tha coapariaon ia af fact ad by correcting any 
aiealignaent batwaan tha two flows of data; comparing tha data of aach 
atraaa of tha first flow with tha data of tha corrasponding straaa of tha 
aacond flow to provida a diffaranca or alara valua Indicating tha 
aignificanca of tha pratanca of a suspacted pixel in tha straaa; and 
datacting a defsct at a pixel location according to ft diffaranca or alara 
valuta corrasponding to tha N straaas of data* 

rig. 12 la a functional block diagraa of tha Phasa X laaga 
processor . It includes an input froa aach of tha eight sensors 4 6a- 4 6b . 
(aach corrasponding to photodetector sensor 46 in rig. 7* to their 
respective preprocessors 6a*6g. The sensore convert the light eignals to 
analog electrical aignala, and tha praproceisors saaple th% * attar signals 
at pixel intervals and convert thea to digital data. Tha outputs of the 
preprocessors are thus in the form of streams of pixel values forming a 
digital version of tha image. 

As shown in rig. 13, the preprocessor 6 in each channel includes 
a preamplifier 56 which converts tha currant received froa its respective 
sensor 46 into a voltage and amplifies it to a level suitable as an input 
to an A/0 converter 57. The paraaetars of amplification can be controlled 
in accordance with the characteristics of the signal received frca the 
inspected wafer. The A/D converter 57 samples the analog voltage and 
converts it to a digital value. Sampling of tha image is carried cut 
continuously to obtain t two-dimensional image of tha object. 

Two flows of eight streaas of data are thus generated: One flow 
represents the pixels of eight different images of the reference pattern 
previously stored in a temporary oeaory; and the ether flow represents the 
pixels of different images of the inspected pattern to be compared with 
those of the reference pattern in order to provide an indication of the 
presence of a defect in the inspected pattern. The detection of defects is 
made in a Defect Detector circuit 60a-60h for each of the eight streams. 

The processing system illustrated in rig. i2 further includes an 
Alignment Control Circuit 62 which controls a Regiatrator Circuit 64a-64h 
for each second Defect Detector circuit 60a-60h. Thus, the Registrator 
Circuita 64a # 64c, 64e and 64g continuoualy monitor the registration 
between tha reference and inspected images. They produce a score matrix 
for each of the chosen registration points, and output a acore matrix 
(i.e., a matrix of values) for eacn of the possible shift positions around 



th« current registration point* The Alignment Control Circuit 62 analyzes 
the score matrices obtained from four of the sensor charm* 1* (i.e., every 
othtr one) , It computes tha valua of alignment arror signals (D , 0 ) where 
tha beat match occur a, and outputs tha alignment control signals to tha 
Defect Detector circuits 60a-60h to correct misalignment between the two 
flows of data straws. 

The Defect Detector circuits 60a-60h feed their outputs to a 
Decision Table 66 which makes a decision, based on the alar* values 
obtained from all eight senaor channels, as to whether a Global Defect 
Alarm (i.e., a logical output indicating the existence of a defect at a 
given location) should be issued or not. The Decision Table 66 thus 
receivea, as inputs, the alarm valuaa from ail eight channels, and outputs 
a Defect flag* 

Xach of the eight alarm valuea haa one of three values (0, 1 or 
2) indicating no alarm, low alarm, and high alarm, respectively. The 
decision table ia set to output a defect flag "1", indicating the existence 
of a defect if, and only if: (a) at least one alarm value ia "2 H ; and ibi 
at least two adjacent alarm values are *2" or "1" (alarm values of channels 
"a" and *'g w are adjacent). 

The output of Decision Table 66 is applied to a parameters buffer 
circuit 68 which records the parameters describing each defect, such as the 
exact coordinates and the type (to be explained later) and intensity of the 
pixels in the immediate vicinity of the defect in both the inspected and 
reference images. It receives as inputs the alarm flag trigger CO" 
indicates no defect, and "1" indicates a defect), and ",11 the parameters to 
be recorded, the latter are received from temporary memories associated 
with each of the eight channels. The parameters suffer 66 outputs a list af 
the defects accompanied by their parameters to the post processor 14. 

Tha post processor 14 receives the list of suspected defects, 
together with their relevant parameters, and makes decisions before passing 
them on to the mam controller for proceasing by the Phase II image 
processor system. It outputs a list of suspected points to transmit to the 
Phase II examination system, including their parameters, and also a list of 
defects which will not be transmitted to the Phase II examination aystem. 

rig. M more particularly illustrates the Defect Detector (e.g., 
60a) and its associated Registrator (64a) in one channel of the image 
processor of rig. 12. 

Detection of defects by the defect detector in each channel is 
based on the comparison of each pixel in the inspected stream with the 



corresponding pixel In the corresponding reference stream. Pixels ere 
compered relative to en edeptlve threshold determining detection 
sensitivity according to pixel type. The type of each pixel is determined 
by pixel characteristics, such as signal intensity and shape in a 3x3 

neighbourhood. 

Thus, the digital ieage fro* the preprocessor <6a-6h) in the 
respective stream is fed to a Threshold Processor 70, and also to a Delay 
Buffer 71. The outputs from the Threshold Processor 70 and the Delay 
Buffer 71 are applied to Pixel Characterizes 72 and 74, Pixel 
Characteriaer 72 is in the Registrator Circut 64a (Pig. 12) which circuit 
outputs signals to a Score Calculator 73 (Pig, 14) controlling (with three 
other streams as indicated above) the Alignment control circuit 62 (Pig. 
12). Pixel Characterixer 74 is used for comparison. It is connected to a 
Reference Die Memory 75 which also receives the signals from the delay 
buffer 71 and outputs signals to the Score Calculator 73 and also to a 
Pixel Aligner 76* the latter output ting signals to a Comparator 77. 

Comparator 77, which is included xn the Defect Detector 60 for 
each channel , carries out a comparison between the inspected image in the 
vicinity of the current pixel, and the reference image in the vicinity of 
the corresponding pixel. The comparison is made with respect to a 
threshold level which is dependent on the pixel type of the current pixels 
in the reference image and inspected image. 

Thus, Comparator 77 includes four inputs: (1) reference pixels 
input (a)/ corresponding to the intensity of the pixels in the reference 
image; <2) reference type input (b), corresponding to the type of pixel in 
the reference image; <3) inspected type input (c), corresponding to the 
type of the pixels in the inspected Image; and (4) inspected pixels input 
id), corresponding to the intensity of pixela in the inspected image. As a 
result of the comparison performed by Comparator 77, it outputs an alarm 
value, via its Alarm output (e), of three possible results of the 
comparison; (a) exceeds higher thresholds; (b) exceeds lower threshold 
only; and (c) below the threshold. As shown in fig, 12, the outputs of 
Comparator 77 in all eight streams are fed to the Decision Table 66, 

The Threshold Processor 70 computes the thresholds for 
classification of the pixels as they are scanned. The computation is based 
on histograms of the characteristic parameters. There are three thresholds 
for each parameter: (a) for decision on registration points; lb) for 
classification of pixels m the reference image; and (c) for classification 
of pixels in the inspected image, 
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Threshold Processor 70 receives the pixel stress froa the scanned 
object via iti preprocessor (e.g., 6*, fig. 12), end outputs its threshold 
levels to the Pixel Cherscterixers 72 and 74 , one for registration and one 
for the comparison. 

Delay Buffer 71 delays the processing in the respective Defect 
Detector (e.g., 60a) and Registrator (e.g., 64a) until the thresholds have 
been computed. This ensures that the thresholds are set according to the 
parameters in the area which is being • canned. Thus, it receives the pixel 
streaa froa the object being scanned via its respective preprocessor, and 
outputs the same to the two Pixel Character iters 72, 74, and to the 
Reference Die Memory 75, after a suitable delay. 

Pixel Characterixer 74 computes the type of the current pixel. 
Thus, during the scanning of the reference pattern it coaputes the type of 
each pixel in that image for storage in the Reference Die Memory 75; and 
during scanning of the inspected pattern, it continuously computes the type 
of the current pixel which is transmitted directly to Comparator 77, 

Pixel Characterixer 72 selects registration points on the basis 
of the pixel type, determined from the results of the computation of pixel 
parameters and their comparison with thresholds. Thus, its inputs are the 
inspected image from the Delay Buffer 71, and the thresholds for all the 
pixel parameters from the Threshold Processor 70; and it outputs 
registration point flag* to the Score Calculator 73 for points chosen as 
the registration points. 

The Score Calculator 73 computes the score matrix of correlation 
between the inspected and reference images in all the possible shifts 
around the current pixel, up to the maximum allowed. It records three 
inputs: (ai the inspected image, to define the area around which the 
correlation la checked; (b) the reference image, to define the range of 
possible matches within the saxisum range of horizontal and vertical 
shifts; and (c) a control input, froa Pixel Characterixer 72, allowing the 
choice of registration points on the basis of pixel type. 

The outputs of four (of the eight) streams are fed to the 
Alignment Control Circuits 62 (fig, 12) in order to calculate the proper 
registration. 

Pixel Characterixer 74 computes the type of the current pixel. 
Thi's, during the scanning of the reference pattern, it computes the type of 
each pixel in that image for storage in the Reference Die Kemory 75; and 
during the scanning of the inspected pattern it continuously compute* the 



type of the current pixel* which is transmitted directly to the Comparator 

77, 

Pixel Charactsriser 74 includes two inputs; (a) ths digital 
image, outputttd from ths Delay Buffer 71; and (b) the threshold values 
from the Threshold Processor 70 for the relevant parameters, to enable a 
decision to be sade as to the pixel type. Pixel Character! ter 74 is 
described sore particularly below with respect to Fig. 17. 

The Reference Die Memory 75 stores an image of the reference 
pattern* This image contains both the intensities of the pixels and their 
classification type. It includes a Pixels input (a), receiving the gray 
level for each pixel from the Delay Buffer 71 , and a Type input (b), 
receiving the pixel classification froa the Pixel Characterize 74. The 
inputs are active only when the reference pattern is being scanned, and the 
reference image is retrieved when needed for the purpose of comparison with 
the inspected image. It Includes a Pixels output (b) applied to the Score 
Calculator 73 and also to the Pixel Aligner 76, and a Type output applied 
to the Pixel Aligner 76. 

The Pixel Aligner 76 executes an advance or a delay in the pixels 
being outputted by the Reference Die Memory 75 before they reach the 
comparison stage, *n order to align them with the current pixel in the 
inspected image. Its inputs are the pixels intensity and type outputs from 
the Reference Die Memory 75, and also an alignment control input from the 
Alignment Computer 62 trig. 12}; and it outputs the reference image pixel 
streams with an advance or delay. 

Comparator 77 carries out a comparison between the inspected 
image in the vicinity of the current pixel, and the reference image in the 
vicinity of the corresponding pixel. This comparison is aede with respect 
to a variable threshold level, which is dependent on the pixel type of the 
current pixel in the reference and inspected images. Thus, its inputs 
U)-£d) include the pixels intensity and type in the reference image from 
the Pixel Aligner 76, and the pixel intensity and typ* in the inspected 
image from the Delay Buffer 71 and Pixel Characteriser 74, respectively. 

Pig. 15 more particularly illustrates the Registrator (e.g., 64a) 
of rig. 14, especially the Threshold Processor 70, Delay Buffer 71, Pixel 
Characterise 72 and Score Calculator 73. 

As described earlier, the Threshold Processor 70 computes the 
thresholds for classification of the pixels as they are scanned, the 
computation being based on histograms of the characteristic parameters. 
The Threshold Processor thu* include! a Pixel Parameters Calculator 70a, 



which calculates the parameters of the current pixel on the basis of its 
immediate surroundings; « Histogramaar 70b which computes the histogram of 
the current pixtls paraaatars; and a Threshold Calculator 70c which 
examines tha histogram for each parameter and determines from it the proper 
value of threshold for that parameter* 

The Delay Buffer 71 corracts tha timing of tha arrival of tha 
rafaranca and inspactad images to that of tha arrival of tha registrstion 
point flags from tha Pixel Charecterisar 72, Thus, Dalay Buffer 71 
includas a buffar 71a for tha inspactad lamge, and a buffar 71b for tha 
rafaranca image* 

Tha Pixal Character iter 72, as dsscribad with rafaranca to rig. 
14, choosas tha ragistration point on tha basis of tha pixal typa. It 
includas tha following eubunits: a Pixal Paraaatars Calculator 72a, which 
calculate* tha paraaatars (gradient, ratio, maximum) of tha currant pixal 
on tha basis of its immediata surroundings; Thrashold Comparators 72b which 
compara these paraaatars with tha thrssholds which hava baan sat separately 
for aach parameter by tha Thrtshold Processor 70; and a Decision Typa Tab la 
72c, which datarmines, on tha basis of tha rasults of tha comparison by tha 
Threshold Comparators 72b, whather tha currant pixal is suitabla at tha 
sampling point to carry out ragistration. 

For every ragistration point tha corraspondanca of its 3x3 pixals 
neighbourhood is aaasur ad against pixals in a range of +R in tha 
corresponding streaa. Fig, 14a illustrates tha algorithm. For each of tha 
( 2R* t )x<2RO } possible misalignments, a correlation measure is computed as 
the normal i ted sum of absolute difference* The correlation matrices 
computed for different registration points are summed, and the minimal 
value in the matrix corresponds to the correct misalignment, 

Tha Score Calculator 73, as described earlier with reference to 
rig, 14, computes the score matrix of correlation between the inspected and 
reference images in sll the possible shifts around the current pixel, up to 
the maximum allowed {plus or sinus vertical and horizontal ranges). This 
unit includes the following circuits: delays 73a, 73b, to correct tha 
timing of the arrival of the inspected and reference images, respectively, 
to that of the arrival of the Registration Point flags from the pixel 
characterizer 72; Neighbourhood Normal iters 73c, 73d, to normalise tha 
pixels in the neighbourhood of the current pixel; Absolute Difference 
Calculator 73e, which finds the absolute difference between the inspected 
image in the vicinity of the current pixel as against ail tha possible 
matches in the reference >mage within the maximum range of shifts in tha 
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vertical and horizontal axes, and computes the score matrix for these 
matches; and Scora Matrix accumulator 73f which luaa and atoraa all tha 
acora matrices which ara accumulated during tha scanning of a number of 
successive rows, bafora transmitting tha* to tha Alignment Computer 62 
(rig. 12) for computation of tha bast match. 

Tha Neighbourhood Normalixers 73c, 73d, norma li tar tha pixala in 
tha naiohbourhood of tha currant pixal in accordanca with tha following 
formula: 

1 1 

t t PU*n,j*m) 

Pnew « PUj) - *Uj) whara «ij « n— 1 »»- 1 

9 



Tha Thraahold Procaaaor 70 of riot. 14 and 15 ia mora 
particularly illuatratad in rig. 16. As dascribad earlier, it eomputaa tha 
thraaholda for claaaif ication of tha pixala aa thay ara scanned, tha 
computation being baaad on histograms of tha charactaristic parameters. It 
includes, in addition to tha Parameters Calculator 70a, tha Histogrammer 
70b and tha Threshold Calculator 70c dascribad above with reference to Fig. 
15, alao a delay line 70c, which delaya tha pixels received at the input to 
tha pixel flow circuit until a column of three pixels from three adjacent 
rows are received. These pixels ara delayed in a pipeline delay subunit 
70d before being applied to the Histograamer 70b, 

Tha Parameters Calculator 70a includes a Fatio Calculator 70e t 
and a Gradient Calculator 70f. 

The Ratio Calculator 70e computes the ratio between the current 
pixel F(ij), and the average of the pixels in the surrounding area in the 
vertical and horizontal directions. If outputs the following signals: the 
ratio in tha horizontal direction (Rhi; the ratio in the vertical direction 
<Kv); and the ratio to the average of the four surrounding pixels (Ri}). 

The Gradient Calculator 70f calculates the gradient in the 
surroundings of the current pixel P(lj) in a matrix of 3 x 3 adjacent 
pixels by operation of a convolver with the following coefficients: 
In the VERTICAL DIRECTION: 



In the HORIZONTAL direction; r 
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Tha outputa of tha Ratio Calculator 70a ara applied to a Ratio 
Tabla of Lavala 70g, bafore being fad to tha Hiatograausar 70b, and tha 
outputs of tha Cradiant Calculator 70f are appliad to a Gradient Tabla of 
Lavala 70h bafora baing fad to tha Hiatograsusar 70b. 

Tha Thraahold Processor illuatratad in rig* 16 furthar includaa a 
Kaxlmua Daflnltlon circuit 70i, which ukaa a daciaion on tha current pi sal 
in ralation to its lurroundinga, to dafina tha following paramatars: 
MUji • 1, if tha pixal ia largar (highar in intensity) than all tha 
aight tur rounding pixels; M(v) • 1, if tha pixal ia largar than ita two 
neighbour! in tha same column; and M(h) • 1 , if tha pixal ia largar than 
ita two naighboura in tha aaaa row. 

Tha outputa of tha Maxima Definition circuit 70i ara appliad, 
via a pipolina delay circuit 70j, to tha Histogrammar 70b. 

Tha Ratio Tabla of Lavala 70g dividaa tha ratio raiult! into X 
group! in ordar to build tha hiatogran. Tha K groupa ara obtainad by 
comparison with a vactor of K thrashold laval Cr<K), which indicataa a 
different araa of tha tabla for aach thraahold, 

Tha Gradient Tabla of Lavala 7 Oh dividaa tha gradlant raaulta 
into L groupa for tha purposa of building tha histogram. Tha L groupa ara 
obtained by comparison with a vactor of L thraahold lavala Cr(L), which 
indicata a diffarant araa of tha tabla for aach thraahold* 

Hisogrammer 70b axacutaa a histogram of tha pixal intenaitiaa 
P(ij) in diffarant call! of tha memory in accordanca with tha following 
pararcetere: MtMaximum); L (Gradient); and K(Ratio). 

Tha Thrashold Calculator 70c in tha Thrashold Proceeeor 70 
illuatratad in rig, 16 is a microprocessor which receive* tha raaulta of 
tha Histogrammed analyzes the*, and computes tha thresholds for a decision 
on tha pixal typa, for: Registration, Referenca X«aga, and I nc pec ted 
Image. It output! tha results to tha Pixal Typa Characteriser 72 and 74, 
as described above with reference to rig. 14* 

Thua, tha Pixal Typa Characteriser 74 includaa fiva Comparators 
74bj*74bg which compare tha various parameters (Ratio, Cradiant and 
Maximum} which hava been previously computed in units 74a^, 74* 2 , 
with tha thrashold lavala coming from tha Thraahold Processor 70* Thus, 
Comparator 74b t compares tha pixel flow with tha Intesity thraahold Z fro* 
tha Thrashold Processor 70; Comparators 74bj, 74b^ compara tha outputa of 
tha Ratio Calculator 74a f with tha Ratio thresholds R and Rhv, respectively 
from tha Thraahold Processor; and Compara tor a 74b., 74b. compara tha 
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cutputi of the Gradient Calculator ?4« 2 with tha Gradient thresholds G and 
Ghv of the Threshold Processor 70. 

Tha raaulti of these comparisons ara fad to tha Decision Tab la 
74c , which alao receives tha output parameters fro» tha Mexioua Definition 
Unit 74a 3 M(ij) to decida on tha pixal typa. 

Tha output of tha Decision tabla 74c ia a two-bit word indicating 
tha pixal typa. Tha output ia appliad to a Typa Updating unit 74d, which 
modifies tha results of tha Pixal typa in cartain exceptional cases, such 
as a pixal alopa naxt to a pixal paak (i.a., to distinguish batwaan an 
"isolated peak* and a "aultipeak") . 

A pixal is assigned a typa according to tha following four 
parameters computed for its 3 x 3 pixals neighbourhood: (1) local aaxiaa 
indicator, <2 i intensity, (3) ratio, and (4) gradient, rig. 17a 
illustrate* tha algoritha to determine the pixel typa fro* theaa 
parameters, computed as follows: 

1 . Local maxima - indicates if a pixal is a maxiaua relative to 
its neighbours. 



1 if f 2 2 ir t for ail 1 < i * 3, 1 s j i 3. 



2. Intensity - indicates if the intensity of tha pixel is 
significant relative to a threshold defined dynamically in a window of 
n x m pixels. 

i (r 2 2 ) . i if t 2 2 z t,. 

3. Ratio * indicates if the intensity of the pixel is 
significant with respect to its neighbours relative to a threshold defined 
dynamically in a window of n x m pixels. 

4 x r, 

„> ■ 1 if 
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4. Gradient - indicates if the pixel is located in a slo * area 
of 3 x 3 pixels relatival to a threshold defined dynamically in a window cf 
n x m pixels. 

g(F, ,) i I if max r®0i i T* 



where 0^ are gradient operators and x is convolution. 
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The type assigned to a pixel may be cam of the following; 
isolated peak, nultipeak, slope and background* The type 1* assigned 
according to the pixel* a parasaters as follows; 

1 • Isolated peak - if the pixel is a local maxima with 
significant intensity and ratio. 
t(r 2 2 >.t if m(T 2 2 )«1 and lif 2 ^ )^^ and r(F2,2)«1 

2. Multipeak - if the pixel ic not an isolated peak, it has 
significant intensity a.'d none of its neighbours Is an Isolated peak. 
t<r 2 2 )«2 if KF 2 2 )-1 and ttr^J-1 1*1*3, 1*}<3 

3. Slope - if either one of the pixel's neighbours is an 
isolated peak or it has significant gradient. 

t(F 2,2 J " 3 i£ t{r i,j* * 1 f0r Soft * Ui 'l* z axcept t 2 2 
or 

4. Background - if the pixel has no significant intensity, or 
gradient and none of its neighbours is an isolated peak. 

£ir^ 2 )«4 if I<r 2 2 i«i and 9tr 2#2 )-t and t( f t )«1 1<i<3, 1*3*3 

The foregoing are inplemented by the Ratio Calculator 74a 1 
illustrated in Fig. 18/ by the Gradient Calculator 74a^ illustrated in fig, 
19, and by the Maxisum Definition Calculator ?4a^ illustrated in rig. 20, 

Thus, the Ratio Calculator 74a ^ makes a decision about the 
central pixel in the matrix, and compute* the ratio of the pixel intensity 
to its immediate neighbourhood. 

The possible decisions about the central pixel in the matrix are 
as follows: (a) maximum, i.e., greater than any of its neighbours; (b) 
vertical maximum, i.e., greater than its vertical neighbours; and lc^ 
horizontal maximum, i.e., greatar than it" horizontal neighbours. 

The computation of the ratio of the pixel intensity to its 
immediate neighbourhood is: (a) in relation to the four immediate 
neighbours, if it is a maximum; and tb) in relation to the two relevant 
neighbours, if it is a vertical or horizontal maximum. 

The Ratio Calculator includes nine registers, shown in fig. 18a. 
Their functions are to record the nine values , designated by the letter 
A-X, of the pixels m a 3 x 3 matrix. 

The Gradient Calculator 74a 2 is more particularly illustrated m 
Fig. 19. Its function is to compute the values of Cradient of the matrix 
in the vertical and horizontal directions. The calculation is based on the 
following formulae: 



2 x Gh t ((A*B*CJ*2*B) - «G*UH)*2*H) 
2 x Cv - ((A*C*D)*2*D) - liC*UT)*2+T) 
0 uch that the calculation represent* multiplying the following matrices: 
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The circuit calculates the valuta of tht Cradiant which includes 
tha following componanta: 

a) Regis tar Matrix: A to I, in which tha valuaa of tha pixala in 
tha matrix ara recorded. 

b) Left Vertical: adds the pixela in the left column according 
to the formula: 

(A*G*D)*2*0 

c) Right Vertical: adds the pixela in the right column according 
to the formula: 

<C*X*F)*2*F 

d) Horizontal Up: adds the values of the pixela in the upper 
row, accord ign to the formula: 

(A*C*B)*2*B 
a) Horizontal Down: adds the values of the pixels in the lower 
row according to the formula: 

(C ♦ I ♦ H) » 2 ♦ H 
The Maximum Definition Calculator 74a^ in Fig. 17 is more 
particularly illustrated in Fig. 20, Its function is to compare, by means 
of comparators, the value of the central pixel Z with those of its 
neighbours, to determine the following parameters: 

a) Mv(i,$) - A logical signal which shows the condition that the 
central pixel t is greater than its vertical neighbours B and H. 

b) Mhti,j) - A logical signal which indicates that the central 
pixel E is larger than its horizontal neighbours 0 and F. 

c) M(l,j) - A logical signal which indicates that the central 
pixel t is larger than ail its neighbours A, B, C, D, F, C, H, I. 

The ratio definition calculator computes the value of the Ratio 
parameter from the following two values: 



a) ftlj - The ratio of the central pixel to Its surroundings . 

Z 

<l ♦ K ♦ 0 ♦ r> /4 

b) Rvh « The rttio of the central pixel to the average of its 
vertical sad horizontal neighbours. 

I 

if Mv(i,j) « 1 than Rv • 

(1 ♦ H)/2 

X 

if Mh(i,j) • 1 than Rh ■ 

(0 ♦ f)/2 

Tha Registration Scora Matrix Calculator 73 (Fig. H) is mora 
particularly illustrated in Pig. 22. This calculator includes a dual-port 
memory 73a-73c to temporarily store a window of up to 25 consecutive rows 
in the reference image, for the purpose of computing the score matrix of 
matches to a smaller window (up to three rows) in the inspected image. The 
memory has two channels of accsss: channel 3d, to store the image by input 
of the stream of pixel data continuously; and channel 73e, to output a 
window containing a strip of three rows wide, as required. 

An input Address Counter 73f generates the pointer for the 
address at which tha current pixel is stored; and an output Address Counter 
73g generates the pointer for the address from which is output ted the 
window on which registration is kept out. The input Address Counter 73 f 
selects the memory via a memory selector 73h. The storage of a window from 
the reference image is carried out in such a manner that each new row is 
inputted to a different one of the three memories 73e-?3c, so that the 
first memory contains rows 1, 4, 7, etc.; the second memory 73b contains 
rows 2, 5, 8, 11, etc.; and a third memory 73c contains rows 3, 6, 9, 12, 
etc. 

The Registration Score Matrix Calculator 73 illustrated in Fig. 
22 further includes a crossbar switch 73i. Its function is to transmit 
three consecutive rows, and to allow switching of these rows each time that 
a computation of s full row of the score matrix is completed, and there is 
a need to move to the next row. As an example, initially rows t, 2, 3 are 
passed to outputs A, 8, C; next, rows 2, 3 and 4 are passed to outputs /, 
8, C, respectively; and so on. The combinations are shown in the diagrams 
illustrated in rig. 22a. 
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The Registration Score tutrix Calculator 73 illustrated in fig. 
22 further includes a converter 73k which convarts tha atraaa of currant 
pixala to thraa pixali in para Hal from tWaa conaacutiva rows. Tha 
con vara ion la carriad out by aaana of two TITO (firat-in, firat-out) delay 
linaa 73k^, 73k^, connactad in aariaa and aach having a langth of ona 
complete row. 

Calculator 73 furthar includaa a dalay 731 for tha purpoaa of 
synchronizing tha appaaranca of tha currant pixal in tha inapactad image 
with tha corresponding pixal in tha output of tha rafaranca image, bafora 
inputted into tha acore matri;* calculator for atorage of tha raapactiva 

window. 

Tha Scora Matrix Calculator 73j compute* tha acora matrix between 
tha inspected and rafaranca image* for all poeeible ahifta of the window. 
This method of computation ia described more particularly below with 
reapect to Fig. 23. 

Tha Scora Matrix Calculator 73} receivea thraa pixala from three 
consecutive rows, from which are produced the nine pixels which form the 
inspection image. The nine pixels are frozen while tha score matrix ia 
being computed* Calculator 73 j also receivea three pixels fron three 
consecutive rows from which are produced the nine pixela which form tha 
reference image . The nine pixels change with each clock pulse, until all 
possible combinations of the 3x3 matrix within tha search window have 
been completed. 

Tha result of tha normalised difference between the inspected 
image and the reference image is outputted every clock pulse, until all 
possible combinatic.ns of the 3 x 3 adjacent pixels within the search window 
are completed* 

The Score Calculator 73 further includes a Score riFO Memory 73m. 
Its function ia to regulate the timing of the transfer of the normalized 
results, which represent the score matrix, from the Registration Score 
Calculator 73 j to the Score Accumulator 73f. 

The Score Accumulator 73 f sums the score matrix which haa been 
calculated for one registration point, to that for a recond registration 
point, tt thus assembles a sample of registration points until the final 
matrix is passed to the Alignment Computer 62 (Fig. 12) to compute the Ox 
and Dy alignment control signaia. 

The Registration Score Matrix Calculator 73 j illuatrated in Fig. 
22 is more particularly shown in Fig. 23. It computes the score matrix 
based on the normalized difference between the inspected image (3x3 
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pixels in extent), And all thi K x N possible matches in the corresponding 
matrix in the reference image. 

Calculator 73 j includes a Pixel Normalise 81 (rig. 23} for the 
inspected image; a Pixel Norma liter 62 (or the reference image; a 
Difference Calculator 83; a Summation Calculator 84; a Division Table 65; a 
Multiplier 86; a Results Storage device 87; and a Score Accumulator 88. 

Pixel Normal izer 81 for the inspected image includes a 
registrator window 61a whose function in to convert the format of the 
inspected ifliage from a serial stream of pixels to a format of a sequence of 
columns of pixels from three consecutive rows; it thus enables, by the use 
of three shift registers of length of three pixels each, immediate access 
to a matrix of 3 x 3 pixels. 

Pixel normaliser 61 further includes a nine-addition circuit 6 lb, 
which sums the intensities of the 3x3 pixel matrix around the current 
pixel. It further includes a 1/9 table 81c which divides the sum of the 
pixel intensities in the matrix by "9", and thereby obtains the average 
value of the pixels in the matrix* 

A delay Bid delays the image data stream until the results of the 
average intensity from table 6tc are available. The output of table 81c is 
applied directly, and via delay Bid, to a group of nine registers 6ie, 
which subtract the average value from each of the nine pixels in the 
matrix. The nine results, representing the normalized values of the 
pixels, are available simultaneously at outputs A- I of the Pixel Normalizer 
61. These pixel values will be frozen, and will serve as the reference for 
comparison throughout the process of computing the score matrix in relation 
to the reference image. 

The Pixel Normalizer 62 for the reference image includes a moving 
window 62a whose function is to produce three consecutive rows in the 
search area having a size of N x N times a 3 x 3 matrix in the reference 
image. The three consecutive rows will supply the pixels needed to produce 
all the possible 3x3 matrices in the search area. Three additionsl 
pixels are acquired once per clock pulse in order to enable a new 3x3 
matrix to be produced. 

Pixel Normalizer 82 further includes a Nine-Addition circuit 82b 
which sums the values of the matrix, and a 1/9 Table 82c which computes the 
average of the pixels in the matrix. The reference data stream from the 
moving window 62a is delayed by a delay circuit 62d until the results of 
the average intensity from table 82c is available* so that both may be 
supplied simultaneously to the nine registers 62e. The nine registers 82e 



subtract the average value froa each of the nine pixels in the aatrix, to 
that the nine results representing tha normalized values of tha pixels ara 
aval labia simultaneously at outputs A-I. 

Difference Calculator 63 computes tha sua of tha absoluta 
difference* of tha 3x3 matrix of tha inspected image varau* tha rafaranca 
image. For this purpose, Calculator 83 includes, for eech of tha two Pixel 
Noraailzers B1 and 82, a Subtraction Circuit 83a, 63b consisting of nina 
subtractors which compute tha dif faranca between* aach pixal in tha 
inspected iaage varsus tha corresponding pixal in tha rafaranca iaage; an 
Absoluta Value Circuit 83c, 83d, which computes tha absolute value of tha 
differences; and a Matrix Circuit 63e, 83f, which suss all the nine 
absolute values. The result of tha absolute sua of the differences is 
PAbb^A to the Multiplier 86* 

Multiplier 66 also receives the output froa the Summation 
Calculator 64 via tne Division Table 85. Thus, the Summation Calculator 64 
computea the absolute sun of the two matrices on which the processing will 
be carried out. It include*, for each Pixel Noraalizor 81, 82, an Absolute 
Value Circuit 84a , 64b, which computes tha absolutes values of each 
normalized pixal; end a Matrix Sua Circuit 84c, B4d, which sums the nine 
absolute valuea. 

Division Table 65 prepares the results of the summation for tha 
operation of division by means of the Multiplier 86. Division Table 85 
executes the arithmetic operation "1 divided by the sua", by converting the 
values using a PROM (Programmable Head Only Memory) table. 

Mulitipler 86 computes the result o the normalised difference for 
the point under tost. The computation is carried out using the formula: 

SCORE . tElP r P R l)Mi/(r|P 2 |*|p R |)) 
where P^, P R are the normalised values of the pixels. 

The Result Storage Device 67 temporarily stores the results of 
the score at a atorage rate which is the same aa that at which the results 
appear, and at an output rate matching the timing of acceptance of the 
results by the Score Accumulator 86. The Score Accumulator 88 sums the 
score matrix obtained at the current registration point with the score 
matrix obtained tX the previous registration point. Summing of the 
matrices at the registration point is carried out for the defined sequence 
of window*, up to X consecutive rows, before the result of the Score Matrix 
is passed to the Alignment control circuits 62 (Fig. 12) for processing. 

the construction and operation of the Defect Detector, as 
illustrated for example in rig. 14, will be better understood by reference 
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to rig*. 24 and 25. At describer earlier, tha function of Comparator 77 is 
to carry out a comparison betwean tha inapactad iaaga in tha vicinity of 
tha currant pixai, and tha rafaranca iaaga in tha vicinity of tha 
corraaponding pixel, and to output an Alarm signal, via buffar 6« (Fig. 
12) , to tha Post Processor 14 indicating whethar or not thara is a 
suspactad defect. As also indicatad earlier, tha comparison is made with 
raspact to a variabla thrashold laval, which is dapandant on tha Typa of 
tha currant pixel in tha rafaranca and inapactad iaages. 

Tha comparison slgoritha la illustratad in Fig. 25a, Aa shown 
therein, a pixal in a stream of tha inapactad image is coaparad against tha 
corrasponding pixal in tha rafaranca iaaga. Tha coaparison is dona undar 
tha assumption that a local misalignment of plus or ninus ona pixel may 
exist. Accordingly, a pixal is coaparad to tha nina pixals in tha 3x3 
neighbourhood centarad at tha corrasponding rafaranca pixal. 

Each of tha nina comparisons is mada by comparing tha difference 
between the energies of the compared pixals against a threshold determined 
by tha pixal typa. Tha energy of a pixal is tha sum of tha nina pixals in 
the 3x3 neighbourhood centered at tha pixal. Tha alarm value is sat to 
H 2", if tha difference in all nine comparisons is above tha high threshold; 
to #, 1 H , if it is above tha low threshold; and to "0 M in all other cases. 

Comparator 77 {rig. 24) thus includes a neighbourhood Energy 
Calculator 77a, 77b for the inspected image and tha reference image, 
respectively. Calculators 77a, 77b compute the energy of tha surroundings 
of the current pixel in a 3 x 3 matrix of the near neighbours in tha 
inspected image, and in tha corresponding reference image. Delay lines 
77c, 77d (Fig. 25) are provided before these calculators in order to 
produce suitable delays before and after the current pixel in order to 
obtain the three relevant rows for computation of the energy in the 
vicinity of the current pixel. The two calculators receivm, as inputs, tha 
relevant pixels in the three relevant rows surrounding tha current pixel, 
and output tha arithmetic sua of the nine pixels m tha 3 x 3 matrix around 
the current pixel. 

Comparator 77 further includes Neighbourhood Registers 77e, 77f 
for storing tha energies in the two Calculators 77a, 77b, respectively, and 
further Neighbourhood Registers 77g, 77h. Their function is to prepare, m 
parallel form, the nina relevant Types (T1*T9) around tha currant pixel in 
the reference image, in order to determine the threshold level to b« used 
in the execution of nine simultaneous comparisons. Thus, tha Energy 
Neighbourhood Registers 77e, 77f, output nine energies E1-E9; whila tha 



Type Neighbourhood Registers 77g, 77h output nine types T1-T9 around the 
current pixel. 

Comparator 77 further includes nine conversion table* 771 for the 
low threshold level, end nine conversion tables 77} for the higher 
threshold levels. These tables tre loaded prior to the inspection session. 
The tables are selected froe a set of tables according to the required 
sensitivity of the detection, ss set by the user. Their function is to 
mutliply each one of the energies around the pixel being examined by a 
constant which depends both on the type of the examined pixel in the 
reference image, and the type of the current pixel in the inspected image. 

Thus, tables 771, 77j receive as inputs; (a) Type <ij), namely 
the type of the current pixel in the inspected image; <b) Type (1-9), 
namely the type of the pixel examined around the current pixel in the 
reference image; and '.c) Energy t (1-9), namely the energy of the examined 
pixel in the reference image. The tables output signals EK{1-9), namely the 
multiplication results of the input energy £(1-9), by a constant which 
depends on the type of both the current pixel and the examined pixel. That 
is: 

CK(1-9?«K(Tlj l T) • EU-9). 
Each of the tables 771, 77 j, is connected to a Compare circuit 
77k, 771, whose purpose is to compare the current energy El) and the 
multiplication results of the energy of the pixel and a constant, £K(1-9J. 
The Compare circuit outputs logical indications of the result of the 
comparison, namely: 

1 If EXM-9)iEUj} 

0 If EK(1-9)>E(1)K 
A High Threshold Decision unit 77» tests whether all the 
comparison outputs sxceeded the high threshold; and a Low Threshold 
Decision unit 77n tests whether all the comparison outputs exceeded the low 
threshold. The combination of the outputs of decision tabl-i 77n and 77» is 
the alarm value. These eight alarm veluns are inputted to the decision 
table 66 which outputs the defect flag ta the post -processor 14 (fig. ?2) 
via the parameters buffer 63. 

The post -processor 14 (rig. 12) thus receives Cue list of 
suspected defects, together with their relevant parameters, and makes 
decisions before passing them onto the Phase IX examination system.. These 
decisions include: (a) clustering; (b) choosing the points which will be 
passed to Phase XI; and (c) the optimum route in Phase II. The latter 
functions are carried out by microprocessor programs. 



gvfall Svitti 

As briefly described earlier, th« Phase XX examination is 
effected automatically upon the completion of the Phase X examination while 
the wafer is still on the table 2, but only with respect to those locations 
of the wafer tt indicated during the Phase X examination as having a high 
probability of s defect* Thus, while the Phase X examination is effected at 
a relatively high speed and with a relatively low spatial resolution, the 
Phase XX examination is effected at s such lower speed and with a much 
higher spatial resolution, to indicate whether there is indeed a defect in 
thoae locations suspected of having a defect during the Phase X 
examination. 

Briefly, the Phase XX examination is effected by: imaging on 
converter 9 (Pigs. 1 and 26), e.g., a CCD, each suspected location of the 
inspected pattern, and the corresponding location of the reference pattern, 
to output two sets of electrical signals corresponding to the pixels of the 
inspected pattern and the reference pattern, respectively; and comparing 
the pixels of the inspected pattern with the corresponding pixels of the 
reference pattern to indicate a defect whenever a mismatch of a 
predetermined magnitude is found to exist at the respective location* To 
accom/nododata variations in the thickness of the wafer and/or pattern, 
and/or multi -layer patterns, each suspected location of the inspected 
pattern, and the reference pattern, is imaged at a plurality of different 
depths, and the electric signals of one set are shifted with respect to 
those of the other set to match the respective depths of the images, 

Phq2e.il. PPUc.SvgUffi 

The Phase IX optic system is shown generally in Fig. 1 and more 
particularly in Fig. 26. Xt includes a microscope objective tOO mounted in 
a rotating turret 101 carrying different objectives to enable bringing a 
selected one into the optical path between the wafer W and the image 
converter 9. The wafer tf is illuminated by a flashlamp unit 102 via an 
optical device 103 having a beamsplitter 104 and a second beamsplitter 105, 
Unit 102 also contains a continuous light source, such as a standard 
tungsten lamp, which is used with a standard TV camera 110 and/or viewing 
system XXX, described below. 

Beamsplitter 104 reflects the infrared portion of the light 
reflected from the wafer to an autofocus unit 106, while beamsplitter 103 



f0 H*ct* the flash light to the wafer If on the vacuus chuck 24 (Tig 3) via 
th# selected objective 100* Beamsplitter 109 aleo p«ffM tha light 
reflected by the wafer tt via an imaging lens 107 end another beamsplitter 
106 to th« image converter 9. Beamsplitter 106 reflects a part of the image 
via another beamsplitter 109 to a stairlard TV camera 110 and/or to a 
viewing system 111 having binocular eyepieces. Tha binocular viewing system 
111 parmits an obsarvar to via* tha w*fer visually, while tha TV camera 110 
permits viewing tha wafer via a TV monitor. 

Ph«t 2 ircm Processor. 

rig* 27 illuatrataa both tha Phase 2 image praprocaaaor 10 and 
tha Phaaa 2 iaaga procaaaor 11* 

Tha information datactad by tha iaaga convartar 9 ia fad to a 
praamplifiar 120 in tha praprocaaaor 10, to a digitizer 121, and than to a 
memory buffer 122 in tha image procaaaor 11. Tha iaaga procaaaor 11 
further includes a digital signal processor which, under software control 
(block 124) from the main controller i8, Fig. 2), performs the following 
operations aa indicated in rig. 27: a matching operation 125, a 
registration operation 126, a comparison operation 127, and a 
classification operation 128. The output from the digital aignal procaaaor 
123 is than returned to the main controller 6* 

Fig. 27 further Illustrates the Phaaa 2 image processor 11 as 
including a hardware accelerator 1 29 for accelerating particularly the 
registration and comparison operations. 

The foregoing operations are described more particularly below 
with reference to Tigs. 28-31. 

As described earlier, the input to the Phase XI image processor 
includes two sets of images, taken from the inspected pattern and the 
reference pattern, respectively. Each set includes five images taken with 
focusses at different depths in order to accommodate variations in the 
thickness of the wafer or pattern, or to accommodate multi-layer patterns. 

As more particularly shown in rig. 28, the reference images and 
the Inspected images are subjected to a depth matching operation 125 
matching the two depth sets, and also to a registration operation 126, in 
which misalignment between the reference and inspected images is detected 
in each depth. The list of misalignments is fed to the compare circuit 
127, Circuit 127 compares the grey level images, pixel by pixel, using 
surrounding pixels and adaptive thresholds obtained from a dynamic range 
equalization circuit 129, the latter circuit compensating for process, 



iUualnfttion and other variations. Tha output of compere) circuit 12? 
indicate! euapected defects, location and acora, and la fad to tha defect 
claaaification circuit 128. Circuit 126 cheractariaea tha data da fact a 
utilising, not only tha output of tha compare circuit 127, but alao 
pravloualy gathered data aa atorad in tha data baaa 130. Tha output of tha 
dafact claaaification circuit 128 ia fad to tha main controller (8, riga. 
1, 2) for diaplay, print-out, or tha liken 



PtPth Hitching 

riga. 29-31 more particularly iliuatrata how tha dapth matching 
oparation la performed* Thua, tha aaquanca of imagaa taken from tha 
inapactad pat tarn ia mat chad with thoaa taken from tha reference pat tarn. 
Tha goal ia to match aach imaga of tha inapactad pattam with tha imaga of 
tha rafaranca pattam takan at tha corresponding dapth of focua. Two 
aaaumptiona ara mada: (1) tha images ara takan in tha ordar of incraaalng 
dapth with a fixad difference batwaan aach two coneee *<ve imagaa; and {2) 
tha arror in tha dapth of tha first imaga of tha ♦ ia ia at most 

tha difference between two consecutive imagaa. 

Hence, If 1^, ttitS and 1si*5 ara * and rafaranca 

images, respectively, tha matching procadura da, x ia ona of 

-1,0 or 1 auch that t^**^) * P* ir of compel jgea {see rig. 29), 

for i 5, Corralation in tha dapth of focua of two imagaa ia maaaurad 
by computing aimilarity in tha varianca of gray lavala in tha two imagaa* 
Tha corralation sea sura usad ia tha diffaranca batwaan tha gray laval 
histograms of tha imagaa. Tha ahift x ia computad aa tha ona providing the 
best corralation for all iaagaa in tha aaquanca. 

rig. 30 mora particularly illuatrataa tha matching procadura. It 
la compos ad of tha following steps: 

(1) Compute tha gray laval histograms for all tha imagaa (blocks 
131, 132). Tha gray laval histogram of an imaga containa tha distribution 
of tha gray lavala. Tha histogram H of an imaga contains in its call 
N(j), tha number of pixals in tha imaga that has a gray laval aqual to j. 

{2} Computa tha distanca batwaan tha histograms (block 133). Tha 
distanca ia takan as tha sum of absolute diffarancaa between corresponding 
calls in tha histograme, The distance will be computed aa follows: 
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m K ^#H^i * r « th » histograms of K ,X. respectively. 

(3) Create the distances table (block 134). This table contains 
the correlation measures computed for each pair of images. 
d(R, 



d(R. - I t ) 



d(R t -x.) 
d(Rj-Zj) 



(4) rind the diagonal in tha distance table providing th« least 
means (see rig. 31) by computing tha means of tha threa main diagonal* 
{block 135), and choosing tha laast mean (block 136}, to produce the depth 
shift. The shift x corresponds to the diagonal providing the minimal mean, 
thus minimizing the overall distance between the two sets. 



pepniUv?-?^era-Cvmparison, 

As described above, both the Phase X and the Phase XX 
examinations may be effected by a die-to-die comparison or by a repetitive- 
pattern comparison of repetitive pattern units on the same die (or other 
article), rig. 32 illustrates such a repetitive pattern on the same die. 

The repetitive pattern illustrated in rig. 32 consists of a 
number of relatively small (e.g., a few microns in size) comparable units. 
A typical comparable unit in a repetitive-pattern comparison is shown as 
the area bounded by the dashed line 200 in rig. 32. As therein shown, each 
pixel along the scanning line 202 is comparable to a pixel which is located 
at a distance M d H either to its left or to its ri-;ht. Since the two pixels 
that have to be compared are contained in the same scanning line, no 
registration has to be done between the "inspected" and the "reference" 
utage, as will be shown below. 

rigs. 33, 34 and 35 are block diagrams which correspond to rigs, 
i?, 14 and 24, respectively (which figures relate to a die-to-die 
comparison in the Phase X e> sination;, but show the changes involved m a 
repetitive- pat tern comparison. To facilitate understanding, and also to 
simplify the description, only those changes involved in the 
repetitive-pattern comparison of rigs. 33, 34 and 35 are described herein; 
in addition, comparable elements are generally correspondingly numbered as 
in Figs. 12, 14 and 24, respectively, except are increased by "200". 

With respect to the overall functional block diagram illustrated 
in rig. 33, the system receives as inputs: (1) signals from the N sensors 
<N*8 m the illustrated embodiment), and (2) a shift control signal 204 
whicn determines the distanct (in pixels) between the current pixel and the 
shifted pixel to which the current pixel is compared. The shift (in 
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t correspond* to tht distance M d" in Fig. 32, and it supplied to the 
iyatem *>Y th * uttr P rlor t0 ^ inspection operation. The ayste* processes 
the N in? 11 * * i ?n* 1 '» and out put a a liat of locations suspected aa defect*. 

Tha ayitaa illuatratad in Fig, 33 (relating to a repetitive- 
pat tarn caparison) differs froa that in Fig. 12 (relating to a die-to-die 
comparison) in tha following raapacta: 

(1) Tha aiigrwent control unit 262, and tla registrator units 
264a-264h for aach second detection circuit 260a-260h appearing in rig. 12, 
are absent froa rig. 2. 

(2) A ehift control signal 204 is inputted to determine the 
comparison distance ("d", rig. 33). 

(3) rol lowing the decision table 266, an alarm killer unit 266a 
ia added. Its function is to suppress defect indications which result froa 
non- repetitive zones, i.e., zones in which the conpariaon distance ia not 
equal to "d". The inputs to the alarm killer unit 266a are an Alarm Hag 
£iwra the decision table 266 and a Masking Flag froa a masking memory 266b. 
The output of the alarm killer circuit 266a ia a Defect Flag, which is "1" 
(meaning "defect") if both the Alarm Flag and the Masking Flag are M t M . 

The masking memory 266b generates information needed for the 
alarm killer unit 266a in order to suppress false indications of defects 
that result from non- repetitive zones. It* input is a bit-map which 
contains a M 0" for the pixels that must not be compared (i.e., pixels for 
which the comparison distance is not equal to "d"), and a "1" where the 
comparison distance is equal to "d". The bit-map is generated by the user 
by interactive means prior to inspection, and is loaded slice-by-slice to 
the masking memory 266b during inspection. The masking memory 266b outputs 
a Masking Flag which is a "0" for pixels that are not to be compared, and a 
*M M for pixels that are to be compared. 

Fig. 34 illustrates one channel in the processing system of Fig. 
33 for a repetitive-pattern comparison. It will be seen that the following 
units appearing in the corresponding Fig. 14 (for a die-to-die comparison) 
are absent in fig. 34 (t) the pixel charactenzer 72; (2) the score matrix 
calculator 73; (3) the reference die memory 75; and (4) the pixel aligner 
76. The first two of the above units (72, 73) deal with the registration 
between tha reference and the inspected die; and since registration is not 
needed in a repetitive-pattern comparison, they are omitted from Fig. 34. 
The reference die memory 75, and the pixel aligner 76 are replaced by the 
cycle shifter 276a. As mentioned earlier, the shift control signal 204 
determines the amount of shift Un pixels) between the reference pixels and 



type* (inputs a end b to the comparator 272), and th* corresponding 
inspected pixels and types (inputs c and d to the comparator 272). 

rig. 35 Illustrate* aoro particularly tha Defect Detector Portion 
of tha image processor of Fig* 34, and correspond* to fig. 24. This 
circuit compares aach pixal to its corresponding shifted pixel according to 
the shift amount determined by the shift control signal 204; and th* 
comparison generates a one-channel alarm for each pixel having a signal 
which is significantly larger than their corresponding shifted pixels. 

Following are the main differences between the circuit 
illustrated in Fig. 35 (for a repetitive-pattern comparison) with respect 
to the system of Fig. 24 (for a die-to-die comparison J: The reference die 
memory {75, Fig. 24) and the pixel aligner {76, Fig. 24) are replaced by 
the cycle shifter 276a, as described above. The cycle shifter 276a 
generates a shift (la pixels) which corresponds to the comparable unit 
distance (d) in Fig. 34. The shifter amount is determined by the shift 
control input 204, The cycle shifter 276a has three inputs: (a) inspected 
pixels, (b) inspected types, and (c) shift control signal 204. The cycle 
shifter 276a is a standard shift register with programmable length. The 
delay length is determined by the shift control signal 204. 



TgP^OYfPfflt*' IP. fhag* II IxamlMtjgn 

Pigs. 36-39 illustrate a number of improvements in the Phase II 
examination system described above. Fig. 36 generally corresponds to ric,. 
26, but illustrates certain modifications to be described below; Fig. 37 is 
a diagram helpful in explaining these improvements; and Figs. 38 and 39 
generally correspond to Figs. 27 and 28, but show the modifications also to 
be described below. To facilitate understanding and to simplify the 
description, only the changes included in Figs. 36, 38 and 39, as compared 
to figs. 26, 27 and 28 are specifically described below; in addition 
generally comparable elements are identified by the same reference numerals 
except 

increased by "300", and new elements are identified by reference numerals 
starting with "400 M . 

A main difference in the optical system illustrated in Fig. 36, 
as compared to Fig. 26, is that the Fig. 36 optical system uses darkfield 
imaging of the object, rather than brightfield imaging. Thus, it has been 
found that darkfield imaging increases the sensitivity to small defects, 
compared to standard brightfield imaging. Using darkfield imaging in the 
Phase II examination is superior in confirming or rejecting alarms detected 
in Phase I t thereby producing a higher probability of detection and a 



emaller probability of falae alarm* . 

The Phase XX optic*! system at shown in rig. 36 include* * 
darkfield microscope objective 300 mounted in a rotating turret 301 
carrying different objectives to enable bringing a selected ona into the 
optical path between the wafer N and the image convartar 309. Tha wafar w 
ia illuminated by an illumination unit 400 via an optical device 303 
including baas ap lit tar a 304 and 305. Unit 400 is a standard unit, basad 
on a marcury lamp, such as auppliad by Laitx. Xt consists of a 200 watt 
mercury lamp 402, a rsflsctor 404, and a condansar 406. 

Beam splittar 304 raflacts tha infraxad portion of tha light 
raflactad from tha wafar If to an autofocus unit 306, whila beam apllttar 
305 reflects tha light froa unit 400 to tha wafar W on tha vacuus chuck 324 
via tha aalactad objactiva 300. Beam splittar 305 alao pasaas tha light 
raflactad by tha wafar If via an imaging lana 307 and anothar beam splittar 
30S to tha imaga convartar 309. Baaa splittar 308 raflacts a part of tha 
image to a viawing syataa 311 having binocular eyepieces, permitting an 
observer to view tha wafar visually. 

Tha imaga converter 309 is a CCD camera with exposure control, 
such as the Puinix TM 64. 

Fig. 36 further includes a darkfield shutter 408 which enables 
the optics to generate darkfield images by blocking the central zone of the 
illumination beam 18. The optical system illustrated in rig. 36 further 
includes an KD- filter 410 which is used to adjust the illumination 
intensity on the object, and a colour filter 412 which is used to enhance 
the contrast of the image. 

Fig. 37 illustrates the imaging of a number of depth images at a 
single location. In the illustrated example, there are three such depth 
images, but practically any number can be generated according to the 
technique described below. 

The imaging of the locations identified as having a high 
probability of a defect as a result of the Phase I examination, is 
accomplished as follows: the wafer is first moved by means of the XY stage 
(22, rig. 3) so that the possible defect detected by the Phase I 
examination is located beneath the Phase IX objective 300 (rig. 36). The 
autofocus 306 focusses the lens at a predetermined depth relative to the 
object's surface by moving the rotation/level/focus stage 323 to the proper 
Z-position. 

The rotation/level /focus stage .s accelerated to a constant 
predetermined velocity equal to the separation distance th) between the 
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depth images, divided by the tin* between f reset. When the settling 
distance is passed, three (or Any other number) of images ere recorded et 
equally spaced interval*. 

The separation distance (h) between the depth iaages is 
approxinately equal to the depth of focus. This ensures that the defect 
will be imaged at focus *it least in one of the depth images . 

Another feature of the imaging technique illustrated in Fig, 37 
is that the exposure time used for each image is significantly shorter than 
the frame time* This prevents the image from smear inq due to continuous 
motion of the stage 323 in the 2 -direct ion at the ti*e the images are 
recorded. As one example, the frame time may be approximately 16 msec, 
while the exposure time may be 0.5 mec. This short exposure time is 
achieved by the built-in exposure control of the CCD camera 309. 

rig. 38 illustrates both the Phase XZ image preprocessor 310 and 
the Phase IX image processor 311. 

The information detected by the image converter 309 is fed to a 
preamplifier 320 in the preprocessor 310, then to a digitizer 321, and then 
to a memory buffer 322 in the image processor 31 t. The image processor 311 
further includes a digital signal processor which, under software control 
{bock 324) from the nam controller (8, Fig. 2), performs a comparison 
operation 327, and * classification operation 328. Since the comparison 
distance (d) is small for typical repetitive patterns, it is assumed that 
the CCD frame contains at least two comparable units. Therefore, it does 
not perform a matching operation or a registration operation, corresponding 
to operations 123 and 126 in Fig. 27. The output from the digital signal 
processor 323 is then returned to the mam controller. 

Fig. 38 further illustrates the Phase IX image processor 311 as 
including a hardware accelerator 329 for accelerating particularly the 
comparison operation. 

The foregoing Gyrations are described more particularly below 
with reference to Fig. 39. 

The input to the Phase XI image processor includes a set of 
images taken from the inspected pattern in the neighbourhood of a suspected 
location designs tod by the Phase I image processor, A set includes five 
images taken with focusses at different depths in order to accommmodate 
variations in the thickness of tha wafer or pattern, or to accommodate 
multi-layer patterns. 



The suspected location zone ia compared against a aieilar pattern 
neighbourhood in the i«ag«, located at the distance *d", left to it, aa 
illustrated in fig, 32. 

Aa more particularly ahotm in Tig. 39, the image* are aubj acted 
to a neighbourhood extraction operation 325, outputting an inapected zone 
and a reference zone for each iaage in the ae*. 

Circuit 327 cosparea the gray level iaagee, pixel by pixel, using 
surrounding pixeia and adaptive threaholda obtained f roe a threehold 
computation circuit 329. The latter circuit coeputea the threaholda at 
each pixel location according to the feature detector contained in circuit 
324. 

The output of compare circuit 32? indicatea suspected defecta, 
location and score, and ia fed to the defect classification circuit 326. 
Circuit 326 characterizea the data defecta utilizing, not only the output 
of the compare circuit 327, but alao previously gather data aa atored in 
the database 330. The output of the defect classification circuit 326 ia 
fed to the main controller (6, rigs, t and 2} for display, printout, or the 
like. 

Inatead of using, aa a reference to be compared with the data 
derived from the inspected article, data generated from real images of 
another like article {in the die-to-die coaarison), or of another like 
pattern on the same article (repetitive pattern comparison), the reference 
data may be generated froa simulated Images derived froa a database; such a 
comparison is called a die-to-database coo pari son. 

The main idea of a die-to-database comparison is: (a) to model 
the database into scattering iaage s, and (bi to compare these images 
against the imagea acc^uired by the imaging system froa the article under 
inspection. The modelling, or simulating of the iaageai is carried out 
using the method described below. The raodelled or simulated images are 
inputted to the systea and play the role of the reference die {in the 
die-to-die comparison), or of the repetitive pattern (in the repetitive 
pattern comparison). 

Thus, in the embodiment illustrated in Fig. 14, each ot the eight 
modelled images la inputted to its corresponding reference die memory 175, 
Fig. 14) in the die-to-database comparison described below, and i* used aa 
the reference streaa input to the comparator 172, Tig. M>. Th« above is 
more particularly illustrated ta the block diagraa of Tig. 40, which 



consists of fc jc blocks of the eodelling systea: s preprocessor 400, s 
apanner 402, a convolver 404, and an adjustment unit 406. The preprocessor 
400 and the adjustment unit 406 are usad prior to inspection, while tha 
spannar 402 and tha convo iver 404 ara usad during inspection. 

Tha modelling of tha scattering is baaad on tha following 
principles: 

(a) tha pattarn of tha objact consists of typical featurea, such 
as comtri and curvas; and 

(b) tha modelling axtracts thaaa features froe tha database and 
associatas with aach faatura its corresponding scattering signal, 

A feature is part of tha pattern which may be described by some 
attributes. The pattern on the inspected objact is described by a liat of 
features. A featura may be either a corner or a curve. 

There are six kinds of comers , as illustrated in rig. 41. each 
corner nay appear in one of eight possible orientations. The orientations 
are given by 0«45*t, where t«0,1,— 7. The corners in rig. 10 ara in the 
orientation of 0«0* (that is, t-0) 

A corner location is the location of the edges intersection. The 
corner characteristics are: 

k - kind, (see rig. 41) 

t - orientation t«0, -—-,7. 

Thare ara three kinds of curves as shown in rig. 42. Curvature 
C«R~ 1 0,0), and normal direction c(0ia>360), are associated with each unit 
length (e.g., one pixel) of curve k*1 or k«2 kind. Curve C*0, normal 
direction a, 0ia*360 and length are associated with each kind k»3 curve. 
The normal direction is always from black to white. This curve location is 
the center of the curve. 

The curve characteristics ara as follows: 
k - kind, k»1,2,3 (see rig. 42) 

L - length, if k-1 or k«2 then L-1, if k-2 then L>1. 
c - Normal direction from black to white, 0* 360*. 
C - Curvature is computed from the radius by R~ . 

To summarise: each feature is represented by class, location, 
and characteristics! where: Class is either a corner or a curve; and 
location it given by (x,y) in a resolution higher than the imaging 
resolution (that is, if pixel size in the image is "p", the location 
resolution is at least p/16). The resolution is chosen such that a 
pmhole/pin dot is at least four pixels. 

The following table summarizes the above: 



- 40 - 



£1IU 

Characteristics 
Location 



gamer 
K, t 

Edge Intersection 



Curve 

K, L, a, C 

Center of Curve 



The role of the modelling is to generate, Used on the features 
described above, a plurality of synthetic or simulated scattering images to 
be compared to the actual image detected by the detectors. In this case, 
there are eight detectors D^Dj, arranged in a circular array, as 
illustrated in rig. 43. 

The modelling consists of two steps: first, high- resolution 
scattering images are generated; and second, the images are convolved in 
order to simulate the optic smears. Two different models are used: one 
model for comers, and another model for curves. 

In the modelling of corners, data is computed regarding the 
scattering intensity and the comer shift. The scattering intensities, 
f(k,t), for all kinds of comers Mk«t,2,— 8) and orientations 
<t«0, 1 , — 7) for detector 0^ are measured and saved. The scattering 
intensity I of corner k at orientation t and detector D is calculated as 
follows: 

I <k,t,D) • f(k,U-on 
where (t-Dj ■ (t-D) modulo fl. 

With each corner kind (k), a comer shift (r/fr) [k] is also 
measured and saved in polar coordinates for t«0. 

The comer shift represents the actual location of the corner 
relative to its location in the database, and is a function of the 
manufacturing process. 

The comer shift can be further understood using fig. 44. The 
actual location of the corner is calculated as follows: 

X actual * X database ♦ Ax 
Y actual • Y database *&Y 
wh*re; X ■ r cos 8 

Y * r sin fl 
and fl • 4*45*t 

The scattering intensities for different values of C are measured 
and saved for 0*a «360 for detector D t and for the three kinds of curves. 
The scattering function is g(k,a,C). A typical function g is described in 
Tig. 45. 

Tig. 45 is an example of g<k,o,C> for k*l (the meaning of k and o 
is given in rig. 46). The function g is given for a number of values of 
curvature C when only two are shown m rig. 45, 0^*0 and C^O (in fact, the 



value C o "0 refers to ft straight lino - k»3). 

The semiring intensities for the other detectors are calculated 

by: 

I(k,o,C,D> • g(k,o-45X(0-U, C) 
Aa a last step, the spatiel diatribution of th« scattered 
intensity in the ieage plane If calculi tod by convolving in convolver 404 
tho high-reeolution scattering image with tho point-apreed function of the 
electro-optical system used for imaging acquisition. 

Tho task of tho prtproeoaaor 400 (fig. 47) la to gonorato tho 
list of foaturoa defining tho object, aa doacribod abovo, aa providod by 
tho databaao. Tho translation of tho polygons data in tho databaao into a 
foaturoa llat ia dona in tho following stops, as illustratod in Fig. 47. 

1, riND tDGX (block 420, rig, 47) - Tranalato polygons data in 
tho databaao into voctor raproaontations doacribing actual odgoa of tho 
pat tarn. rig. 46 providas two examples of tho translation. In tho prasont 
embodiment this stop is dono by using tho Scanlino algorithm froo 
"Computational Geometry" by Preparata r.P. and Shamos K.I. Springer * 
Verlag, New-Tork Inc. Tho output of this stop is a list of segments or 
vectors AB,BC, — etc. , aach of which is roprasantod by its two and points. 
Tho segments aro ordarod in sots; aach aot roprosonts tho contour of a 
shape* 

2* rtND CURVATURE a NORMAL - (block 422, rig. 47) - Find 
Assoc lit as curvaturo and normal to oach segment* ror aach segment in a 
sat, tho curvaturo and normal aro cooputad using tho neighboring eegaents 
in tho sot* In tho prossnt embodiment this stop is dono using tho 
algorithm of Pavlidit T*, Curvo ritting with Conic Splinos AO! Tran.Cn 
Graphics, 2 (1983) pp. 1*31. Tho output of this atop is a list of segments, 
each of which is associated with two end points, curvaturo and normal. Tho 
segments aro atill grouped in sets representing contours* 

3. FEATUW GENERATOR - (block 424). Generates a liat of 
features. In each set of segments, corners aro detected and tho location, 
kind and orientation, as defined above, are cooputad. tot each segment its 
length, location and kind are cooputad. Tho output of this step is a list 
of features described by class, location, and characteristics* 

A general block-diagram of tho spanner (402, rig. 40) is 
illustrated in rig* 48. The spanner has two inputs: The first input 
contains a sorted feature list, as described above. The second input 
contains the model data f,g, (r/*i. As described above, the function (f,g> 
simulates the scattering signals for the comers (f ) and tho curves (g). 



respectively; whereas the function (r,0) simulates the shift (rounding) of 
the corners by the manufacturing process, as lliuatrated In fig. t3. The 
spanner uses the feature data and the model data in order to generate eight 
high- resolution scattering Images. 

*" The method used for generating these ieage* can bo further 
understood using rig. 49. The spanner (402, figs. 40 and 17) first 
classifies the feature to be either a corner or a curve (block 430) and 
then uses the appropriate aodel in order to calculate the scattering 
intensities from the features. Since a straight line (curve of kind k-3) 
consists of L tegmenta, the sase scattering ins tensity is aasociated with 
each segment of the line. 

Thus, as shown in the flow chart of Fig. 49, if the feature is 
determined to be a corner, the system computes the actual location (x',y*) 
aa shown in block 432; then cosputes the intensity X(k,t,D) for each 
detector 0^-0^ (block 434); and then assigns the correct intensity in the 
right location for each det actor (block 436) . 

On the other hand, if the Mature is determined not to be a 
comer (i.e., a curve), a check is made to determine the kind of curve. 
Thus, if "k* ia not a straight line as shown in fig. 42 (block 436), a 
computation is made of the intensity (block 440) , and of the edge points of 
the segment (block 442); and then the correct intensity is assigned to the 
correct location (block 444). On the other hand, if the feature is 
determined to be a curve (block 436), a computation is nude of the 
intensity (block 446), and then the correct intensity is assigned in the 
correct location for each detector (block 448). 

The convolver (block 404, Tig* 40) carriea out a convolution on 
the high-resolution image input. The kernel of the convolver simulates the 
point-spread function of the electro-optical image. The output of the 
convolver is an image with a pixel size which is identical to the one of 
the acquired image. Such convolvers are well known. 

The adjustment unit (block 406, fig. 40) uaes input Images of 
known curves and corners in order to build the models for f,g and (r,+). 
The images used for adjustment purposes may be known test patterna. The 
adjustment proceea is made prior to Inspection and may be done once for 
each type of product. The models of f,g and (r,41 are used by the scanner 
as described above. 

In the preferred embodiments of the invention described above, 
both the Phase I examination and the Phase XX examination are effected, one 
automatically after the other. It is contemplated, however, that the 



invention, or faaturas tharaof, could also ba anbodiad in apparatus which 
af facts only tha first axaaination or only tha aacond axaai nation. It ia 
alao contaaplatad that tha apparatus could ba auppliad with tha capability 
of aff acting both axaainationa but with miwm for disabling, a.?., tha 
aacond axaainatlon, if not raquirad for any particular application. 

Many othar variations. Modifications and applications of tha 
invantion will ba apparant. 



k method of Inspecting the surf act of article* for defects, 

comprising: 

placing the article to be inspected on a table; 

in a first phase, optically examining the complete surface of tha 
articla on tha tabit inspected at a relatively high speed and with a 
relativaly low spatial resolution; 

alactrically out put ting information indicating auapactad 
locations on tha articla having a high probability of a da fact; 

storing aaid output tad information in a storage device; 

and in a second phase, while the article is still on said table, 
optically examining with a relatively high spatial resolution only said 
suspected locations stored in said storage device for the presence or 
absence of a defect in said suspected locations, 

2. The method according to Claim 1, wherein aaid firat examining 
phase is effected by optically scanning the complete article surface to oe 
inspected; and aaid second examining phase is automatically effected 
immediately after the first phase by imaging only aaid suspected locations 
on a converter which converts the images to electrical signals and then 
analyzes said electrical signals. 

3. The method according to Claim 1, wherein said surface of the 
article includes a pattern to be inspected; and said first examining phase 
is effected by making a comparison between the inspected pattern and 
another pattern serving as a reference pattern, and identifying locations 
on the inspected pattern wherein the comparison shows sufficient 
differences with respect to the reference pattern to Indicate a high 
probability of a defect in the inspected pattern. 

4. The method according to Claim 3, wherein said second 
examining phase is also effected by making a comparison between the 
inspected pattern and the reference pattern, and identifying locationa on 
the inspected pattern wherein the comparison shows sufficient differences 
with respect to the reference pattern to indicate the presence of a defect 
at the tuspected location of the reference pattern. 

5. The method according to Claim 3, wherein said article to be 
inspected has a plurality of repetitive pattern units, one of which units 
serves as the inspected pattern and ia compared with at least one other 
unit of said article serving as the reference pattern. 

6. The method according to Claim 5, wherein the article to be 
inspected is a semiconductor wafer having a plurality of like 
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inte9 r»t«d-clrcult dies each formed with like patt*nw, the pattern of one 
0 f which dies serves as the inspected pattern and is compared with the like 
pattern of at least one other die serving as the reference pattern. 

7. The method according to Claim 5, wherein the article to be 
inspected is a semiconductor wafer having a plurality of like 

Integra ted -circuit dies, each die being formed with a plurality of like 
patterns, one of which patterns of one die serves as the inspected pattern 
and is compared with another like pattern of the same die serving as the 
reference pattern. 

8. The method according to Claim 5, wherein said first examining 
phase is effected by the following operations: 

generating a first flow of N streams of data representing the 
pixels of different images of the inspected pattern unit; 

generating a second flow of N streams of data representing the 
pixels of different images of the reference pattern unit; 

and comparing the data of said first flow with the data of the 
second flow to provide an indication of the suspected locations of the 
inspected pattern unit having a high probability of a defect. 

9. The method according to Claim 8, wherein said comparing 
operation is effected by: 

correcting any misalignment between the two flows of data; 

comparing the data of each stream of the first flow with the data 
of the corresponding stream of the second flow to provide an alarm value 
indicating the significance of the presence of a suspected loca**on in the 
stre.im; 

and detecting a defect at a pixel location according to N alarm 
values corresponding to the N streams of data. 

10. The method according to Claim 5, wherein said first examining 
p«\a£.e is effected by a laser beam which is deflected to scan a line along 
on#* orthogonal axis, while the article to be inspected is physically 
viibpiaced along a second orthogonal axis. 

11. The method according to Claim 5, wherein said second 
examining phase is effected by the lol lowing operations: 

imaging on a converter each suspected location of the inspected 
pattern unit and the corresponding location of the reference pattern unit 
to output two sets of electric signals corresponding to the pixels of the 
inspected pattern umt and the reference pattern unit, respectively; 

and comparing the pixels of the inspected pattern unit with the 
corresponding pixels of the reference pattern unit to indicate a defect 
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e ^mt a ■iaaatch of ft predetermined magnitude la found to exist at tha 

respective location. 

12. The Method according to Claia 11, wherein said imaging 
operation la effected by imaging aach auapectad location of the inspected 
pattern unit and the reference pattern unit at a plurality of different 
depths, and shifting the electric signals of one set with respect to those 
of the other set to match the respective depths of the images. 

13. The method according to Claim 12, wherein said imaging at a 
plurality of different depths is effected by moving the inspected pattern 
unit and reference pattern unit towards and away froe the converter. 

14. The method according to Claim 13, wherein during said imaginq 
at a plurality of different depths* a lamp is flashed at periodic intervals 
while the inspected pattern unit and reference pattern unit are being moved 
vertically with respect to the converter. 

15. The method according to Claim 11, wherein said comparing 
operation is effected by comparing each pixel and its surrounding pixels cf 
the inspected pattern unit with the corresponding pixel and its surrounding 
pixels of the reference pattern unit according to predetermined thresholds 
to indicate the location of any detected defects. 

16. The mothod according to Claim 11, wherein said converter is 
an optic charge -coup led device. 

17. A method of inspecting the surface of an article for defects, 
comprising the following operations: 

generating a first flow of N streams of data representing the 
pixels of different images of the inspected article; 

generating a second flow of N streams of data representing the 
pixels of corresponding images of a reference; 

and comparing the data of said first flow with the data of the 
second flow to provide an indication by said comparison of the suspected 
locations of the inspected article having a high probability of a defect, 

18. The method according to Claim 17, wherein said comparing 
operation is effected by: 

correcting any misalignment between the two flows of data; 

comparing the data of each stream of the first flow with the date 
of the corresponding stream of the second flow to provide an alarm value 
indicating the significance of the presence of a suspected location in the 
stream; 

2nd detecting a defect at a pixel location according to N alarm 
values corresponding to the N streams of data. 
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19. The method according to CUi* 16, wherein said correcting any 
(nisaligruaent if effected by; 

•sleeting corresponding registration points in the streams of 

*ach flow; 

detecting misalignment between the registration points of the two 

flows; 

and shifting one flow with respect to the other flow to correct 
for said misalignment between the two flows. 

20. The method according to Clais 19, wherein said detecting 
misalignment ia effected by computing similarities between corresponding 
streams of data by summing correlation Measures in all possible 
alignments. 

21. The method according to Claim 18, wherein said comparing 
operation includes: 

assigning a type to each pixel in each of the N streams of each 

flow; 

comparing each pixel in each stream of one flow with the 
corresponding pixel in the corresponding stream of the other flow with 
respect to predetermined thresholds which depend on the type assign**d to 
the respective pixel; 

and assigning an alarm value to the pair of pixels in each 
comparison in each stream indicating the probability of a defect in the 
location of the inspected pattern unit corresponding to the respective 
pixels . 

22. The method according to Claim 18, wherein said comparison is 
further effected by detecting a defect at a pixel location according to the 
combination of the N alarm values corresponding to the N streams of data. 

23. The method according to Claim 21, wherein each pixel is 
ar>r.igned one of a plurality of types according to predetermined parameters 
w*th respect to the pixel and ltc pixel neighbours, 

24. The method according to Claim 23, wherein said predetermined 
parameters include: 

(at local maxima, indicating whether the pixel is a maximum 
relative to its neighbours; 

(b) intensity, indicating whether the intensity of the pixel is 
significant relative to a predetermined threshold; 
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(c) ratio of intensity, indicating whether the intensity of the 
pixel is significant with respect to its neighbours relative to its 
predetermined threshold; and 

(d) gradient, indicating whether the pixel is located in a sloped • 
area with neighbouring pixels relative to a predetermined threshold, 

25. The method according to Claim 23, wherein each pixel is 
assigned any one of a plurality of types including the following: 

(a) isolated peak, if the pixel is a local maxima with f) 
significant intensity and ratio; 

(b) multipeak, if the pixel is not an isolated peak and has 
significant intensity, and none of its neighbours is an isolated peak; 

(c) slope, if either one of the pixel's neighbours is an isolated t • 
peak or has significant gradient; and 

(d> background, if the pixel has no significant intensity or 
gradient, and none of its neighbours is an isolated peak. 

26. The method according to Claim 17, wherein said N streams of • 
data m each flow are generated by a circular array of N light collectors. 

27. The method according to Claim 26, wherein said comparable 
pattern units are based on a grid of angularly- spaced lines, and said 

circular array of light collectors include light collectors located to • 
collect the light in region.* midway between the angularly -spaced lines of 
the grid, thereby minimizing the amount of pat tern -reflected light 
collected by the respective light collector. 

28. The method according to Claim 26, wherein said grid is • 
constituted of eight 4b # spaced lines, there being eight light collectors 

and eight streams of data in each of said first and second flows. 

29. The method according to Claim 17, wherein said generating 

operations are effected by a laser beam which is deflected to scan a line • 
along one orthogonal axis, while the article to be inspected is pnysically 
displaced along a second orthogonal axis. 

30. The method according to Claim 17, wherein said article to be 

inspected has a plurality of comparable pattern units, one of which units • 
serves as an inspected pattern and is compared with at least one other unit 
of said article serving as a reference pattern, 

31. The method according to Claim 30, wherein the article to be 

inspected is a semiconductor wafer having a plurality of like • 
mtegrated-circuit dies each formed with like patterns, the pattern of one 
die serving as the inspected pattern and is compared with the like pattern 
of at least one other die serving as the reference pattern. 
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32* The method according to Claim 30, wherein the article to be 
inspected Is * semiconductor wafer having a plurality of like 
integrated-circuit dies, each die being formed with a plurality of like 
patterns, on* of which patterns of one die serves as the inspected pattern 
and it compared with another like pattern of the sane die serving as the 
reference pat torn. 

li. A method of inspecting the surface of an article for defects, 
comprising the following operations; 

imaging, on a converter, each location of the article to be 
inspected and the corresponding location of a reference article at a 
plurality of different depths, to output two sets of electric signals for 
each depth corresponding to the pixels of the inspected article and 
reference article at that depth; 

shifting the electric signals of one set with respect to the 
electric signals of the other set to match the respective depths of the 
images; 

and comparing the pixels of the inspected article with the 
corresponding pixels of the reference article to indicate a defect where a 
mismatch of a predetermined magnitude is found to exist at the respective 
location of the inspected article. 

34. The method according to Claim 33, wherein said imaging at a 
plurality of different depths i& effected by moving the inspected article 
and reference article towards and away from the converter. 

35. The method according to Claim 33, wherein during said imaging 
at a plurality of different depths, a lamp is flashed at periodic intervals 
while the inspected article and reference article arts being moved with 
respect to the opto-electric converter. 

36. The method according to Claim 33, wherein said comparing 
operation is effected by comparing each pixel and its surrounding pixels of 
the inspected article with the corresponding pixel and its surrounding 
pixels of the reference articJe according to predetermined thresholds to 
indicate the location of any detected defects. 

37. The method according to Claim 33, wherein said converter is 
an optic charge -coup led device. 

38. The method according to Claim 33, wherein said article to be 
inspected has a plurality of comparable pattern units, one of which units 
serves as the inspected pattern and is compared with at least one other 
unit of said article serving as the reference pattern. 



39. Tha aethod according to Claia 39, wherein tha articla to be 
ir}S pactad la a semico; luctor wafer having a plurality of like 

Integra tad-circuit diaa aach foraed with lika patterns, tha pat tarn of ona 
dia serving aa tha inspactad pattarn and it compared with tha Ilka pattarn 
of at laaat ona othar dia aarving aa tha rafaranca pattern. 

40. Tha method according to Claia 38, wherein tha articla to ba 
inspactad is a saw i conductor wafar having a plurality of lika 
mtegrated-circuit diaa, aach dia baing formed with a plurality of like 
patterns, ona of which pattarna of ona dia serves as tha inspactad pattarn 
and is coaparad with anothar lika pattarn of tha aame dia aarving as tha 
reference pattarn. 

4f. inspection apparatus for inspecting tha surface of articles 
for defects, comprising: 

a table for receiving the article to be inspected; 

first examining means overlying said table for examining in a 
first phase the complete surface of the article thereon at a relatively 
high speed and with a relatively low spatial resolution, and for outputting 
information indicating suspected locations on the article surface having a 
high probability of a defect; 

storage means for storing the output of said first examining 

means ; 

and second examining means overlying said table for examining, in 
a second phase and with a relatively high spatial resolution, only said 
suspected locations stored in said storage means, and for outputtmg 
information indicating the presence or absence of a defect in the suspected 

location, 

42. The apparatus according to Claim 41, wherein said first 
examining means includes optic scanning means for optically scanning the 
complete article surface to be inspected; and said second examining means 
includes imaging means for imaging only said suspected locations on a 
converter which converts the images to electrical signals. 

43. The apparatus according to Claim 42, wherein said converter 
is an optic charge-coupled device. 

44. The apparatus according to Claim 4), wherein: 

the article to be examined has a plurality of comoaraM* ***ttern 
units to be inspected, by comparing each such unit, identi r :-«3 us an 
inspected pattern unit, with at least one other pattern uni*, utroTitied *a 
a reference pattern unit; and 



said first examining Mini includes Mane for output ting 
information identifying locations on the inspected pattern unit in which 
the comparison shows sufficient differences with respect to the reference 
pattern unit to indicate a high probability of defect in the inspected 
pattern unit. 

45. The apparatus according to Claim 41, wherein said table is 
constructed to support a semi-conductor wafer having a plurality of like 
mtegrated-circuit dies each formed with like patterns, the first and 
second examining means being located to examine and compare the pattern of 
one die serving as the inspected pattern unit with a like pattern of at 
least one other die serving as the reference pattern unit, 

46. The apparatus according to Claim 45, wherein said table is 
constructed to support a semi-conductor wafer having a plurality of 
integrated-circuit dies, each formed with a plurality of like pattern 
units, the first and second examining means being located to examine and 
compare each pattern unit of one die serving as the inspected pattern unit 
with another like pattern unit of the same die serving as the reference 
pattern unit. 

47. The apparatus according to Claim 41, wherein said first 
examining means comprises: 

means for generating a first flow of N streams of data 
representing the pixels of different images of the inspected pattern unit, 
and a second flow of H streams of data representing the pixels of 
corresponding images of the reference pattern unit; 

and a processor for comparing the data of said first flow with 
the data of the second flow, to provide an indication by said comparison of 
the suspected locations of the suspected pattern unit having a high 
probability of a defect. 

48. The apparatus according to Claim 47, wherein said *> r ©c«»£Sor 

includes: 

misalignment correcting means for correcting any mi sal ignm<rr;t 
between the two flows of data; 

comparison means tor comparing the data of each stream of the 
first flow with the data of the corresponding stream of the second flow to 
provide an alarm value indicating the significance of the presence of a 
suspected pixel in the stream; 

ana detector mean* for detecting a defect at a pixel location 
ec tn*d<u<* to H a1.>~* ••- : ■ m orrnpondm** ' j tn* N streams data. 
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49. The apparatus according to Clala 41, wherein said second 
examining means comprises: 

illumination Mans for illuminating each suspactad location of 
tha inapactad article, and a corresponding location on a reference 

article; 

converter means for receiving the images of the illuminated areas 
of the inspected srticle and of the reference article, and for converting 
said images to two sets of electrical signals representing pixels of the 
received images of the inspected article and of the reference article, 
respectively; 

and comparison means for comparing the two sets of images and for 
output ting an electrical signal indicating a defect at a location wherein a 
mismatch of a predetermined magnitude occurs between the inspected article 
image and the reference article image. 

50. The apparatus according to Claim 49, wherein said second 
examining means further comprises: 

depth-varying means for producing a plurality of images on said 
converter means at different depths at said suspected locations on the 
inspected article and corresponding locations on the reference article; 

and shifting means for shifting the electrical signals of one set 
with respect to those of the other set to match the respective depths of 
the two sets of images. 

51. The apparatus according to Claim 50, wherein said 

depth- varying means includes a drive for moving the inspected article and 
the reference article towards and away from said converter to produce said 
plurality nf images at different depths. 

52. The apparatus according to Claim 49, wherein said 
illuminating means includes a flashlamp which is periodically flashed to 
permit successive illuminations of the inspected article and the reference 
article on-the-fly while said articles are in motion. 

53. The apparatus according to Claim 49, wherein said comparison 
means includes a processor which compares the two sets of images pixel -by - 
pixel, with each pixel including its surrounding pixels, in accordance with 
predetermined thresholds. 

54. The apparatus according to Claim 53, wherein said comparison 
means outputs signals indicating the lot it ion of each defect detected. 

55. Apparatus for inspecting articlea having a plurality of 
comparable pattern units to be inspected, by comparing each such unit, 
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identified at an inspected pattam unit, with at leaet ana othar, 
identified aa a reference pattern unit, comprising: 

a tabla for supporting tha article to ba inipixfd; 

means for generating a firat flow of * atraaaa of data 
representing tha pixala of different iaages of tha in* pec ted pattern unit, 
and a second flew of N atraaaa of data representing tha pixels of 
corresponding iaagea of tha reference pattam unit; 

and a processor for comparing tha data of aaid firat flow with 
tha data of tha aecond flow, to provide an indication by aaid comparison of 
the suspected locations of tha suspected pattern unit having a high 
probability of a defect, 

56. The apparatus according to Claim 53, wherein aaid processor 

includes: 

misalignment correcting iteans for correcting any aisal ignmant 
between the two flowa of data: 

comparison meana for comparing the data of each atraaa of the 
first flow with the data of tha corresponding atreaa of tha second flow to 
provide an alara value indicating the significance of the presence of a 
suspected pixel in the atreaa; 

and detector means for detecting a defect at a pixel location 
according to N alara values corresponding to the N streams of data. 

57. Th« apparatua according to Claia 56, wherein aaid 
misalignment correcting means includes: 

misalignment detector means for detecting misalignment between a 
registration point in at least one stream of each flow; 

and shifting means for shifting one flow with respect to the 
other flow to correct for said misalignment. 

56. The apparatua according to Claia 5?, wherein aaid 
misalignment detector means includes means for computing similarities 
between coi res pond i%g atreams of data by summing correlation measureaenta 
at selected luxations in all possible misalignments. 

59. The apparatus according to Claia 56, wherein said meana for 
computing similarities comprises a correlation matrix including a 
correlation measure for each possible misalignment between the two streams, 
and said shifting means shifts one stream with respect to the other 
according to the output ot iaid correlation matrix. 

60. The apparatus according to Claim 56, wherein aaid comparison 
means Includes assigning meana for assigning each pixel in each stream of 
each flow with one of a plurality of typea according to predetermined 



parameters with respect to It and its pixel neighbours, and means for 
comparing corresponding pixels in the two stream* with respect to 
predetermined thresholds which depend on the typo aesigned to th* 
respective pixel in tho inspected-articl* stream of pixels. 

61. Tho apparatus according to Cleia 60, wherein aaid comparison 
means includes means for detecting a da fact at a pixel location according 
to th* combination of tho » alarm valuaa corresponding to tho ft streams of 
data. 

62. Tha apparatus according to Ciaia 61, wharain said assigning 
means assignr aach pixel ona of a plurality of typos according to tho 
following parameters: 

(a) local maxima, indicating whothar tha pixal is a maximum 
relative to ita neighbours; 

(b) intensity, indicating whathsr tha intansity of tha pixal is 
significant ralativa to a prodatarainad thrashold; 

(c) ratio of intensity i indicating whothar tha intansity of tha 
pixel is significant with respect to its neighbours ralativa tc its 
predetermined threshold; and 

(d> gradient, indicating whether the pixel is located in a sloped 
with neighbouring pixela relative to a predetermined threshold. 

63. The apparatus according to Claim 61, wherein said parameters 
include the following: 

(a) isolated peak, if the pixel is a local maxima with 
significant intensity and ratio; 

(b) multipeak, if the pixel Is not an isolated peak and has 
significant intensity, and none of its neighbours is an isolated peak; 

(c) slope, if either one of the pixel's neighbours is on isolated 
peak or has significant gradient; and 

(d) background, if the pixel has no significant intensity or 
gradient, and none of its neighbours is an isolated peak. 

64. The Apparatus according to Claim 55, wherein said means for 
generating said first and second flows of H streams of data comprises: 

optic scanning means including a light source output tm<; a light 
beam which scans in two dimensions the complete surfaces of the comparable 
pattern units to be inspected; 

and light detector means for detecting tha light reflected from 
said surfaces. 

65. The apparatus according to Claim 64, wharain said light 
detector means comprises a circular array of light collectors. 
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66 « The apparatua according to Claim 65, wherein said comparable 
pat tarn unit a ara based on a grid of angularly -spaced linn; and aaid 
circular array of light collector a include light col lac tor a located to 
collect tha light in ragiona midway between tha angularly- spaced linaa of 
tha grid, tharaby minimising tha amount of pattern-reflected light 
col lac tad by tha respective light collactor. 

67. Tha apparatua according to Claia 66, wherein thara ara aight 
light collactora apacad apart at 45* intarvala. 

68. Tha apparatua according to Claia 65, wherein said optic 
scanning meana furthar includaa a light deflector for daf lac ting tha light 
beam along ona orthogonal axia, and means for moving tha articla along 
another orthogonal axia to tharaby affact tha two-dimensional acanning of 
tha comparable pat tarn unit a to ba inapactad. 

69. Tha apparatua according to Claia 65, wherein aach of aaid 
light collactora includaa an optic fibra for guiding tha light to tha 
respect Wa light detector. 

70. Tha apparatua according to Claia 69, wherein the light 
receiving end of each of aaid optic fibrea ia of a shaped, curved 
configuration having aidea converging f roe a baae aubstantially parallel to 
the inspected article, to a pointed tip overlying the inspected article. 

71. The apparatua according to Claia 70, wherein the width of the 
light receiving end of each of aaid optic fibrea ia about 16* at ita base 
and forma an angle of about 49* between ita base and ita tip. 

72. The apparatua according to Claia 64, wherein said light 
source ia a laser 

73. The apparatua according to Claim 72, wherein aaid laser 
outputa a linearly polarized beam; and aaid optic acanning means further 
includes a polarizer between the laser and the article to be inspected 
which converts the linearly polarized beam to a circularly polarized beam 
applied to the aurface of the inspected article. 

74. The apparatua according to Claim 73, wherein aaid polarizer 
also converta the light reflected from the article to linear polarization 
orthogonal to the linear polarization direction of the polarized laser 
beam; and wherein aaid optic acanning meana includaa a further light 
detector for receiving the reflected light from aaid polarizer, and a beam 
splitter between the laser and polarizer for reflecting the reflected light 
to the further light detector and for blocking the reflected light from the 
laser. 
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75. The apparatus according to Claim 69, wherein said optic 
■canning means further includes an acouito-optic deflector which deflects 
the light baas along said ona orthogonal axis in a sawtooth pat tarn in the 
time domain; and a driva for driving tha inspactad article along the other 
orthogonal axis to effect the two-dimensional scanning of the surface of 
the inspected article. 

76. The apparatus according to Claim 68, wherein said optic 
scanning means further includes a beam expander between the light source 
and the light deflector, and a cylindrical lens which focusses the expanded 
bean on the light deflector. 

77. The apparatus according to Claim 68, wherein said optic 
scanning means further includes a multi -magnificat ion telescope having a 
rotatabl* turret carrying different objectives for focussing the light beam 
on the article to be inspected. 

78. The apparatus according to Claim 53, wherein said table is 
constructed to support a semi-conductor wafer having a plurality of like 
integrated-circuit dies each formed with like patterns, the pattern of one 
die serving as the inspected pattern unit to be compared with a like 
pattern of at least one other die aerving as the reference pattern unit. 

79. The apparatus according to Claim 55, wherein said tabie ia 
constructed to support a semi-conductor wafer having a plurality of 
integrated-circuit dies, each formed with a plurality of like pattern 
units, one pattern unit of one die serving as the inspected pattern unit to 
be compared with another like pattern unit of the same die serving as the 
reference pattern unit. 

80. Apparatus for inspecting articles having a plurality of 
comparable pattern units to be inspected, by comparing each such unit, 
identified as an inspected pattern unit, with at least one other, 
identified as i reference pattern unit, comprising: 

a table for supporting the articles to be inspected; 

illuminating means for illuminating a predetermined location of 
the inspected article, and a corresponding location of the reference 
article; 

converter means for receiving the images of the illuminated areas 
of the inspected article and of the reference article, and for converting 
said images to two sets of electrical signals representing pixals of the 
received images of the inspected article and of the reference article, 
respectively; 
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and a processor for comparing the two sets of images and for 
outputting an electrical signal indicating a defect at a location wherein a 
mismatch of a predetermined magnitude occurs between the inspected article 
image and the reference article image, 

81. The apparatus according to Claim 80, further comprising: 
depth-varying means for producing a plurality of images on said 

converter means of different depths at said predetermined locations of the 
inspected article and corresponding locations of the reference article; 

and shifting means for shifting the electrical signals of one set 
with respect to those of the other set to match the respective depths of 
the two sets of images. 

82. The apparatus according to Claim 61, wherein said 
depth-varying means includes a drive for moving the inspected article and 
the reference article towards and away from said converter to produce said 
plurality of images at different depths. 

83. The apparatus according to Claim 80, wherein said 
illuminating means includes a flashlamp which is periodically flashed to 
permit successive illuminations of the inspected article and the reference 
article on- the- fly while said articles are in motion. 

84. The apparatus according to Claim 60, wherein said processor 
compares the two sets of images pixel-by-pixel, with each pixel including 
its surrounding pixels, in accordance with predetermined thresholds. 

85. The apparatus according to Claim 84, wherein said processor 
outputs signals indicating the location of each defect detected. 

86. The apparatus according to Claim 80, wherein said table is 
constructed to support a seal -conduct or wafer having a plurality of like 
integrated-circuit dies each formed with like patterns, the pattern of one 
die serving as the inspected pattern unit to be compared with a like 
pattern of at least one other die serving as the reference pattern unit. 

87. Thi apparatus according to Claim 60, wherein said table is 
constructed to support a semi-conductor wafer having a plurality o* 
integrated-circuit dies, each formed with a plurality of like pattern 
units, one pattern unit of one die serving as the inspected pattern unit to 
be compared with another like pattern unit of the same die serving as the 
reference pattern unit. 

86. The method according to Claim 5, wherein said repetitive 
pattern units are spaced from each other a predetermined distance such as 
to define repetitive pattern zones, and the suspected locations output ted 
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fro* said first phase are restricted to locations in said repetitive 
pattern tones. 

89. Tha apparatus according to Claim 45, wherein said like 
patterns in all said die* are spaced fro* each other a predetermined 
distance such as to define repetitive pattern zones; and said first 
examining means includes means for suppressing from the suspected locations 
out put ted froa said first phase those locations not in said repetitive 
pattern tones. 

90. The method according to Claim 2, wherein said suspected 
locations are imaged on said converter by darkfield imaging mean*. 

91. The apparatus according to Claia 42 # wherein said imaging 
means of said second examining means is darkfield imaging means. 

92. The method according to Claim 17, wherein said second flow of 
N streams of data representing the pixels of corresponding images of a 
reference are generated from real images of anothei like article. 

93. The method according to Claim 17, wherein said second flow of 
N streams of data representing the pixels of corresponding i ma yes of a 
reference are generated from real images of another like pattern on the 
earn* article. 

94. The method according to Claia 17, wherein said second flow of 
N streams of data representing the pixels of corresponding images of a 
reference are generated from simulated images derived from a database. 

95. The method according to Claim 26, wherein said N streams of 
data in said first stream are generated by a circular array of light 
collector*, and said end streams of data in said second stream are 
generated from cimulatttd images d* rived from a database. 



ABSTRACT OF THE DISCLOSURE 



A method and apparatus for inspecting the surface of articles, 
such as chips and wafers, for da facts, includes a first phasa of optically 
examining tha complete surface of the article inspected at a relatively 
high speed and with a relatively low spatial resolution, and a second phase 
of optically examining with a relatively high spatial resolution only the 
suspected locations for the presence or absence of a defect therein. 
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